-- Logs begin at Wed 2022-08-10 16:08:30 UTC, end at Wed 2022-08-10 17:17:09 UTC. -- Aug 10 16:46:23.398508 dv-cinder-836027-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 16:46:23.407467 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 16:46:23.409983 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 16:46:23 2022] *** Aug 10 16:46:23.409983 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 16:46:23.409983 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 16:46:23.409983 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: nodename: dv-cinder-836027-6-iscsi Aug 10 16:46:23.409983 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: machine: x86_64 Aug 10 16:46:23.409983 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: clock source: unix Aug 10 16:46:23.409983 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: pcre jit disabled Aug 10 16:46:23.409983 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: detected number of CPU cores: 4 Aug 10 16:46:23.409983 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: current working directory: / Aug 10 16:46:23.409983 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: detected binary path: /usr/bin/uwsgi-core Aug 10 16:46:23.410580 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: your processes number limit is 47680 Aug 10 16:46:23.410580 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: your memory page size is 4096 bytes Aug 10 16:46:23.410580 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: detected max file descriptor number: 2048 Aug 10 16:46:23.410580 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: lock engine: pthread robust mutexes Aug 10 16:46:23.410580 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: thunder lock: enabled Aug 10 16:46:23.410580 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 16:46:23.410580 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 16:46:23.448767 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: Python main interpreter initialized at 0x55f8055369c0 Aug 10 16:46:23.448767 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: python threads support enabled Aug 10 16:46:23.448767 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: your server socket listen backlog is limited to 100 connections Aug 10 16:46:23.448767 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: your mercy for graceful operations on workers is 90 seconds Aug 10 16:46:23.449193 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 16:46:23.449193 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: *** Operational MODE: preforking *** Aug 10 16:46:23.449449 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: *** uWSGI is running in multiple interpreter mode *** Aug 10 16:46:23.449449 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: spawned uWSGI master process (pid: 105501) Aug 10 16:46:23.449653 dv-cinder-836027-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 16:46:23.451008 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: spawned uWSGI worker 1 (pid: 105502, cores: 1) Aug 10 16:46:23.451008 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: spawned uWSGI worker 2 (pid: 105503, cores: 1) Aug 10 16:46:23.451008 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 16:46:24.115992 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 16:46:24.123120 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 16:46:25.215535 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:46:25.215535 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: from cryptography.utils import int_from_bytes Aug 10 16:46:25.216335 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:46:25.216335 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: from cryptography.utils import int_from_bytes Aug 10 16:46:25.228336 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:46:25.228336 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: from cryptography.utils import int_from_bytes Aug 10 16:46:25.228931 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:46:25.228931 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: from cryptography.utils import int_from_bytes Aug 10 16:46:27.752888 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 16:46:27.753491 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 16:46:27.754076 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 16:46:27.754167 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 16:46:27.754258 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 16:46:27.754326 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 16:46:27.754396 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 16:46:27.754463 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 16:46:27.754540 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 16:46:27.754606 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 16:46:27.754670 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.754739 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.754957 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.755055 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.755239 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.755336 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.755557 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.755645 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.755887 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.755984 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.756236 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.756339 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.756559 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.756656 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.756876 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.756972 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.757203 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.757288 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.757462 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.757548 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.757777 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.757863 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.758101 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-6-iscsi {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.758193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-6-iscsi {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.758425 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.758531 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.758727 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.758869 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.759033 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.759117 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.759347 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.759438 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.759652 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.759736 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.759971 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.760061 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.760298 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.760405 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.760798 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.760901 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.761968 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.762101 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.762101 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.762303 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.762383 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.762499 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.762626 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.762709 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.762842 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.762931 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.763055 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.763135 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.763256 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.763350 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.763473 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.763554 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.763674 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.763755 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.763938 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.764036 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.764373 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-6-iscsi {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.764537 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-6-iscsi {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.764688 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.764772 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.765001 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.765132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.765315 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.765511 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.765730 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.765852 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.766034 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.766158 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.766353 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.766457 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.766658 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.766752 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.766974 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.767093 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.767300 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.767399 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.767604 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.767700 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.767922 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.768012 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.768265 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.768360 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.768615 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.768714 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.768918 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.769071 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.769218 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.769364 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.769523 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.769678 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.769824 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.769956 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.770132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.770264 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.770435 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.770584 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.770715 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.770844 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.770974 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.771120 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.771281 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.771434 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.771600 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.771731 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.771923 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.772058 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.772243 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.772390 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.772522 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.772625 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.772740 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.772886 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.773060 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.773210 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.773368 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.773505 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.773675 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.773830 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.773968 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.774097 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.774273 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.774403 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.774581 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.774723 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.774885 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.775020 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.775192 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.775319 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.775501 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.775642 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.775824 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.775962 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.776194 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.776332 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.776477 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.776631 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.776767 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.776901 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.777091 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.777226 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.777486 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.777628 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.777763 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.777895 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.778028 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.778161 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.778359 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.778490 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.778664 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.778822 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.778957 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.779097 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.779280 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.779414 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.779599 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.779730 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.779905 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.780041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.780217 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.780347 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.780533 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.780681 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.780851 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.780996 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.781186 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.781318 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.781492 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.781630 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.781765 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.781911 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.782042 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.782176 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.782307 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.782446 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.782626 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.782764 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.782931 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.783076 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.783237 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.783379 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.783542 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.783682 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.783844 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.783971 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.784687 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.784823 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.784995 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.785138 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.785301 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.785434 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.785605 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.785734 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.785909 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.786039 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.786211 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.786343 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.786515 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.786646 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.786819 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.786959 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.787123 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.787254 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.787440 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.787570 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.787757 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.787896 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.788061 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.788215 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.788389 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.788522 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.788692 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.788850 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.789000 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.789150 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.789304 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.789451 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.789608 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.789743 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.789910 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.790047 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.790229 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.790369 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.790586 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.790721 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.790856 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.791002 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.791145 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.791235 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.791566 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.791651 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.791717 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.791781 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.792021 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.792180 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.792360 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.792492 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.792666 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.792808 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.792985 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.793128 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.793275 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.793418 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.793580 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.793718 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.793882 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.794027 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.794185 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.794313 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.794489 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.794615 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.794789 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.794927 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.795091 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.795218 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.795392 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.795518 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.795692 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.795835 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.796009 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.796199 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.796346 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.796494 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.796644 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.796742 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.796953 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.797089 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.797260 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.797354 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.797572 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.797664 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:46:27.797909 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.797994 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.798240 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.798324 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.798581 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.798667 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.798898 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.799017 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.799266 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.799364 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.799564 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.799650 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.800484 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.800593 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.800786 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.800887 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.801101 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.801188 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.801432 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.801517 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.801743 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.801837 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.802057 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.802194 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.802365 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.802459 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.802684 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.802779 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.803003 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.803116 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.803333 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.803419 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.803648 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.803741 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.803964 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.804048 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.804303 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.804390 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.804617 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.804716 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.804933 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.805028 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.805262 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.805346 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.805586 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.805678 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.805902 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.806010 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.806251 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.806388 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.806592 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.806744 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.806905 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.807051 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.807233 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.807379 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.807551 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.807695 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.807854 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.807995 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.808178 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.808312 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.808449 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.808587 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.808778 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.808925 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.809127 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.809313 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.809533 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.809681 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.809822 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.809962 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.810102 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.810315 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.810465 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.810620 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.810757 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.810922 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.811078 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.811244 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.811398 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.811553 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.811695 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.811784 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.811863 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.811955 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.812113 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.812315 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.812510 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.812605 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.812827 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.812970 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.813140 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.813286 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.813451 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.813544 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.813762 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.813929 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.814067 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.814158 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.814371 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.814460 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.814673 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.814768 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.814981 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.815066 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.815310 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.815406 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.815631 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.815718 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.815957 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.816042 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.816287 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.816375 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.816622 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.816710 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.816931 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.817016 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.817239 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.817323 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.817551 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.817635 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.817859 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.817950 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.818165 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.818263 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.818476 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.818570 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.821859 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.821996 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.822089 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.822181 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.822181 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.822323 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.822389 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.822535 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.822621 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.822709 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.822789 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.822866 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.822950 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.823079 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.823171 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.823266 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.823392 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.823474 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.823559 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.823638 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.823724 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.823812 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.823892 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.823976 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.824055 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.824132 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.824300 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.824389 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.824468 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.824546 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.824630 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.824717 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.824804 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.824937 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.825020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.825352 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.825431 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.825509 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.825595 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.825688 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.825775 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.825854 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.825931 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.826020 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.826100 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.826183 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.826262 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.826339 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.826416 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.826501 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.826580 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.826658 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.826862 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.826951 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.827170 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.827266 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.827475 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.827560 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.827778 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.827863 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.828081 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.828200 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.828423 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.828509 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.828727 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.828803 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.829055 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.829138 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.829363 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.829439 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.829666 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.829748 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.829969 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.830053 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.830272 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.830355 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.830613 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.830687 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.831439 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.831524 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.831835 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.832065 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.832247 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.832378 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.832543 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.832677 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.832820 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.832953 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.833101 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.833245 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.833424 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.833564 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.833738 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.834053 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.834367 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.834682 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.835005 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.835320 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.835650 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.835980 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.836343 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.836662 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.836986 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.837296 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.837380 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.837616 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.837704 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.837961 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.838052 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.838298 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.838386 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.838617 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.838943 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.839259 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.839551 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.839637 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.839873 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.839957 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.840215 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.840307 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.840533 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.840622 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.840849 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.840943 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.841179 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.841265 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.841494 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.841588 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.841817 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.841902 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.842130 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.842229 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.842454 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.842540 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.842767 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.842912 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.843087 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.843219 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.843397 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.843491 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.843713 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.843811 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.844082 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.844377 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.844481 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.844565 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.844728 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.844830 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.845083 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.845229 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.845360 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.845445 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.845687 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.845900 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.845997 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.846315 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.846509 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.847168 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.847506 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.847630 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.847823 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.847982 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.848220 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.848332 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.848485 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.848653 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.848806 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.848976 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.849143 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.849404 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.849513 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.849636 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.849782 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.849967 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.850153 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.850288 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.850422 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.850600 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.857098 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.857241 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.857408 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.857498 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.857594 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.857675 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.857747 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.857830 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.857909 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.857994 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858079 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858155 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858237 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858237 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858376 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858460 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858460 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858614 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858690 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858690 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858826 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858910 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.858910 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859048 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859123 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859197 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859272 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859272 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859418 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859503 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859579 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859706 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859787 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859872 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.859950 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860025 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860107 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860214 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860301 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860301 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860301 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860301 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860301 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860301 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860301 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860301 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860821 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860895 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.860970 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.861059 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.861143 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.861221 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.861295 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.861295 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.861439 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.861515 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.861598 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.861682 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.861748 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.861956 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.862304 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.862623 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.862698 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.862933 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.863007 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.863249 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.863323 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.863572 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.863647 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.863990 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.864187 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.864441 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.864568 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.864711 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.864859 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.865186 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.865519 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.865621 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.865843 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.865928 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.866180 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.866264 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.866585 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.866681 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.866855 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.866945 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.867189 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.867366 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.867484 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.867796 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.868105 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.868223 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.868466 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.868587 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.868782 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.868919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.869096 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.869245 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.869405 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.869571 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.869720 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.869891 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.870030 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.870211 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.870339 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.870542 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.870671 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.870986 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.871126 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.871314 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.871464 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.871624 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.871786 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.871941 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.872113 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.872282 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.872464 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.872612 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.872790 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.872929 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.873128 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.873241 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.873460 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.873543 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.873808 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.873901 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.874122 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.874292 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.874439 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.874532 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.874751 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.874836 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.875062 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.875155 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.875378 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.875462 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.875686 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.875778 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.875995 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.876088 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.876331 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.876418 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.876653 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.876826 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.876942 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.877018 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.877260 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.877351 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.877567 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.877672 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.877897 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.878009 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.878229 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.878383 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.878734 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.879000 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.879000 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.879297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.879442 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.879576 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.879576 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.880067 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.880381 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.880635 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.880895 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881078 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881219 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881470 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881470 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881611 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881678 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881756 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881834 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881900 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.881964 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.882034 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.882147 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.882243 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.882452 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.882542 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.882766 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.882850 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.883072 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.883166 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.883390 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.883475 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.883697 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.883783 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.884005 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.884099 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.884338 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.884446 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.884649 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.884736 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.884951 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.885036 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.885255 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.885348 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.885565 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.885649 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.885877 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.885963 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.886181 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.886273 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.886481 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.886564 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.886790 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.886872 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.887100 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.887327 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.887556 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.887781 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.887995 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.888239 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.888239 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.888503 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.888647 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.888803 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.888939 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.889072 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.889201 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.889325 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.889473 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.889629 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.889772 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.889915 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.890062 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.890212 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.890360 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.890493 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.890617 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.890734 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.890855 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.890967 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.891148 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.891297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.891443 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.891565 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.891743 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.891912 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.892061 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.892319 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.892441 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.892589 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.892753 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.892925 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.893123 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.893304 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.894017 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.894216 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.894374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.894509 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.894655 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.894779 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.894941 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.895181 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.895326 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.895617 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.895806 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.895934 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.896128 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.896312 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.896730 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.896908 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.897228 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.897331 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.897547 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.897671 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.897957 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.898261 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.898376 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.898583 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.898863 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.898975 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.899211 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.899390 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.899609 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.899825 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.900034 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.900204 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.900400 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.900550 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.900739 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.900868 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.901056 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.901196 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.901374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.901530 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.901685 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.901813 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.901994 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.902124 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.902351 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.902485 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.902655 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.902780 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.903021 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.903175 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.903320 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.903471 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.903615 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.903758 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.903941 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.904080 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.904257 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.904393 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.904579 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.904722 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.904893 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.905134 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.905265 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.905402 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.905545 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.905677 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.905808 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.905951 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.906139 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.906261 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.906439 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.906526 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.906745 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.906849 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.907053 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.907136 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.907418 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.907507 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.907664 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.907762 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.907979 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.908064 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.908316 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.908405 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.908629 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.908727 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.908945 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.909044 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.909823 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.909981 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.910132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.910281 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.910444 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.910581 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.910757 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.910898 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.911066 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.911209 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.911377 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.911524 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.911689 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.911848 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.912000 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.912200 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.912337 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.912511 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.912651 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.912882 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.913024 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.913261 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.913355 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.913568 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.913669 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.913873 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.913967 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.914186 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.914278 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.914495 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.914586 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.914797 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.914913 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.915107 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.915217 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.915415 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.915549 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.915726 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.915872 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.916009 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.916162 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.916357 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.916507 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.916682 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.916829 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.916988 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.917127 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.917311 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.917665 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.917665 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.917928 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.918063 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.918194 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.918336 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.918525 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.918663 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.918794 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.918922 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.919047 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.919271 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.919414 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.919584 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.919712 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.919899 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.920042 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.920272 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.920480 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.920609 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.920727 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.920884 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.921020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.921192 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.921315 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.921517 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.921654 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.921822 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.921953 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.922127 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.922264 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.922434 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.922578 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.922746 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.922878 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.923026 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.923163 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.923353 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.923497 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.923781 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.923932 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.924073 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.924240 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.924397 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.924541 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.924762 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.924904 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.925078 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.925222 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.925400 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.925528 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.925724 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.925884 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.926037 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.926188 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.926326 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.926462 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.926622 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.926752 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.926930 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.927077 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.927238 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.927382 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.927562 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.927793 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.927924 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.928060 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.928284 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.928374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.928496 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.928574 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.928800 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.928875 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.929105 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.929179 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.929413 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.929488 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.929736 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.929810 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.930043 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.930117 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.930368 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.930443 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.930685 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.930765 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.931007 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.931090 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.931332 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.931407 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.931640 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.931715 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.931962 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.932043 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.932293 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.932389 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.932664 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.932750 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.932908 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.933032 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.933210 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.933314 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.933529 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.933616 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.933834 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.933921 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.934158 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.934256 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.934454 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.934541 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.934761 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.934856 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.935064 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.935164 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.935366 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.935453 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.935686 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.935778 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.935987 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.936075 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.936340 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.936430 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.936656 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.936743 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.936984 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.937164 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.937287 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.937374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.937589 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.937717 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.937895 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.937982 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.938205 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.938292 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.938505 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.938587 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.938809 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.938895 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.939117 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.939201 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.939423 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.939517 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.939729 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.939814 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.940053 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.940138 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.940411 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.940513 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.940736 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.940858 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.941048 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.941130 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.941353 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.941449 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.941666 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.941760 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.941974 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.942060 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.942298 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.942431 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.942694 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.942834 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.942923 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.943012 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.943206 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.943293 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.943514 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.943598 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.943817 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.943901 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.944121 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.944289 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.944454 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.944548 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.944765 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.944883 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.945066 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.945155 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.945352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.945440 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.945653 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.945739 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.945973 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.946069 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.946276 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.946370 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.946596 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.946692 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.946903 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.946989 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.947207 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.947498 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.947586 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.947813 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.947898 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.948140 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.948260 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.948464 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.948549 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.948778 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.948864 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.949091 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.949182 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.949405 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.949490 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.949718 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.949803 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.950029 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.950367 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.950594 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.950694 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.950904 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.950989 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.951217 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.951303 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.951530 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.951628 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.951842 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.951928 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.952242 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.952360 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.952606 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.952729 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.952868 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.953010 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.953156 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.953302 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.953468 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.953623 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.953829 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.953988 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.954139 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.954287 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.954449 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.954593 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.954737 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.954886 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.955031 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.955177 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.955336 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.955440 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.955649 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.955746 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.956496 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.956612 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.956820 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.956948 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.957140 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.957270 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.957454 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.957584 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.957767 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.957867 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.958083 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.958222 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.958398 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.958549 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.958722 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.958851 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.959037 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.959168 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.959352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.959483 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.959665 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.959795 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.959979 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.960115 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.960326 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.960460 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.960639 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.960875 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.961004 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.961196 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.961327 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.961533 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.961671 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.961850 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.961984 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.962158 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.962294 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.962472 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.962567 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.962784 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.962880 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.963094 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.963182 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.963403 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.963488 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.963711 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.963804 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.964021 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.964105 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.964357 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.964442 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.964669 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.964767 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.964994 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.965080 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.965306 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.965390 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.965618 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.965777 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.965906 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.966025 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.966239 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.966455 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.966767 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.966932 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.967101 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.967358 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.967520 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.967740 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.967901 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.968048 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.968294 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.968452 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.968452 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.968726 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.968726 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.968893 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.969057 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.969231 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.969386 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.969541 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.969703 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.969851 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.969997 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.970140 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.970300 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.970455 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.970611 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.970759 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.970908 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.971051 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.971198 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.971359 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.971507 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.972194 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.972288 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.972367 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.972672 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.972941 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.973034 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.973171 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.973298 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.973488 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.973613 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.973816 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.973925 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.974143 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.974237 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.974464 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.974559 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.974773 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.974860 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.975097 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.975183 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.975406 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.975579 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.975714 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.975813 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.976027 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.976113 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.976362 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.976461 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.976670 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.976755 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.976976 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.977068 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.977287 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.977380 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.977593 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.977749 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.977896 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.977988 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.978207 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.978375 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.978513 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.978650 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.978826 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.978958 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.979133 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.979273 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.979438 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.979579 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.979744 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.979908 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.980241 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.980350 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.980432 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.980510 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.980688 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.980775 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.980994 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.981122 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.981300 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.981389 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.981610 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.981917 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.982027 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.982220 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.982314 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.982525 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.982657 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.982833 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.982973 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.983143 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.983373 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.983577 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.983765 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.983999 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.984136 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.984388 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.984512 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.984633 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.984753 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.984902 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.985027 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.985235 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.985396 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.985548 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.985715 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.985859 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.986012 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.986153 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.986294 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.986447 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.986601 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.986601 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.986887 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.987028 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.987202 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.987344 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.987498 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.987641 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.987820 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.988031 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.988218 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.988364 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.988364 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.988634 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.988775 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.988892 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.988985 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.989074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.989305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.989400 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.989614 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.989701 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.989935 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.990031 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.990245 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.990341 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.990558 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.990642 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.990868 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.990964 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.991181 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.991301 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.991488 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.991572 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.991800 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.991897 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.992113 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.992229 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.992447 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.992535 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.992756 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.992846 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.993072 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.993258 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.993418 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.993567 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.993722 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.993868 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.994005 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.994129 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.994247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.994423 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.994577 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.994734 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.994868 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.995057 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.995190 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.995382 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.995514 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.995699 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.995831 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.996024 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.996172 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.996363 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.996450 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.996697 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.996785 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.997005 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.997092 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.997323 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.997438 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.997633 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.997719 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.997962 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.998098 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.998270 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.998355 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.998574 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.998661 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.998903 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.999074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.999207 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.999300 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.999524 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.999667 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.999826 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:27.999927 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.000137 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.000255 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.000466 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.000551 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.000779 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.000922 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.001087 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.001215 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.001394 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.001529 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.001706 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.001844 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.002013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.002152 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.002319 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.002463 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.002620 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.003004 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.003179 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.003271 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.003340 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.003421 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.003591 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.003706 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.003898 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.003999 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.004229 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.004422 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.004524 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.004607 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.004839 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.004939 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.005146 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.005251 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.005452 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.005537 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.005755 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.005855 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.006055 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.006149 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.006359 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.006446 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.006667 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.006765 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.006971 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.007074 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.007278 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.007367 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.007599 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.007686 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.007887 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.007991 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.008216 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.008330 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.008519 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.008621 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.008824 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.008919 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.009128 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.009223 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.009436 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.009522 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.009739 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.009826 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.010042 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.010131 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.010344 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.010482 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.010647 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.010733 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.010948 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.011034 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.011279 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.011373 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.011607 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.011693 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.011918 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.012002 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.012259 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.012361 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.012569 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.012654 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.012891 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.012973 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.013198 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.013293 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.013516 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.013609 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.013830 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.013924 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.014140 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.014225 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.014447 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.014533 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.014761 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.014867 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.015074 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.015172 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.015377 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.015475 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.015687 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.015773 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.015994 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.016086 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.016331 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.016427 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.016641 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.016737 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.016957 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.017041 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.017279 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.017365 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.017581 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.017674 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.017906 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.017999 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.018229 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.018864 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.019060 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.019160 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.019377 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.019480 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.019686 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.019772 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.020016 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.020102 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.020353 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.020441 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.020668 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.020792 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.020980 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.021102 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.021287 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.021375 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.021596 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.021682 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.021869 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 16:46:28.021955 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.022204 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.022514 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.022828 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.023142 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.023468 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.023792 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.024102 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.024451 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.024777 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.025131 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.025443 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.025786 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.026113 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.026427 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.026736 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.027042 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:46:28.027285 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 16:46:28.178806 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Registered counter for database nova_api Aug 10 16:46:28.193060 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Registered counter for database nova_api Aug 10 16:46:28.201212 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:46:28.208670 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:46:28.215309 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:46:28.222091 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:46:28.265582 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.context [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aab5fae-6c58-46b3-86c8-a7c4cff86d61(cell1) {{(pid=105503) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 16:46:28.270305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:46:28.270794 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:46:28.272879 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:46:28.273990 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:46:28.274652 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:46:28.277874 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:46:28.280327 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Registered counter for database nova_cell0 Aug 10 16:46:28.282558 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.context [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aab5fae-6c58-46b3-86c8-a7c4cff86d61(cell1) {{(pid=105502) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 16:46:28.286272 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Registered counter for database nova_cell1 Aug 10 16:46:28.286800 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:46:28.287282 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:46:28.288930 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:46:28.289682 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:46:28.290128 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:46:28.292172 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:46:28.293862 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:46:28.294324 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Registered counter for database nova_cell0 Aug 10 16:46:28.295136 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:46:28.300235 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Registered counter for database nova_cell1 Aug 10 16:46:28.302342 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:46:28.303858 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:46:28.308395 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:46:28.311648 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:46:28.315001 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:46:28.449645 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Registered counter for database nova_cell0 Aug 10 16:46:28.452396 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:46:28.459491 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:46:28.463159 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Registered counter for database nova_cell0 Aug 10 16:46:28.464056 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:46:28.470259 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:46:28.475109 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:46:28.808532 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 16:46:28.810665 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 16:46:28.815833 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 16:46:28.817985 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 16:46:29.156815 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 16:46:29.162789 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 16:46:29.163599 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 16:46:29.168091 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f8055369c0 pid: 105502 (default app) Aug 10 16:46:29.169694 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-a339c941-02e3-4efd-8165-0acf28d61ce2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 16:46:29.170268 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:46:29.171450 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001808 Aug 10 16:46:29.171854 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Wed Aug 10 16:46:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:46:29.175184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f8055369c0 pid: 105503 (default app) Aug 10 16:47:48.563980 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:47:48.565029 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 10 16:47:48.565656 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:47:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:47:48.577518 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=3 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:47:48.578737 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_cell1:SELECT=3 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:47:48.579928 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_cell0:SELECT=3 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:47:48.581594 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:47:49.480246 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fd5b4ccb-30ee-47d1-848b-b060e4e5ca6e admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:47:49.514945 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-fd5b4ccb-30ee-47d1-848b-b060e4e5ca6e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.942561 Aug 10 16:47:49.515835 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Aug 10 16:47:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:47:51.870394 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:47:51.871393 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-6323d502-ba16-4618-9cd8-8ccac735e792 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 10 16:47:51.876538 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:47:52.381621 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-05d97b2e-6a60-462d-bd0b-938e54bb9d48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:47:52.402285 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:47:52.402285 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: warnings.warn(msg) Aug 10 16:47:52.444089 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-05d97b2e-6a60-462d-bd0b-938e54bb9d48 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.564695 Aug 10 16:47:52.445071 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 10 16:47:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:47:52.460755 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:47:52.461639 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell0:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:47:52.462674 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell1:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:47:52.463507 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:47:52.673538 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-696d2281-f785-4bf4-84f1-6a000b6728d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:47:52.677727 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:47:52.677727 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 10 16:47:52.741771 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-696d2281-f785-4bf4-84f1-6a000b6728d9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287868 Aug 10 16:47:52.742386 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Aug 10 16:47:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:47:54.975420 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-05d97b2e-6a60-462d-bd0b-938e54bb9d48 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:47:54.976471 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-05d97b2e-6a60-462d-bd0b-938e54bb9d48 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 10 16:47:54.976870 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:47:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:47:55.680403 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-7ad38e40-5a2e-457b-8488-f238bd0d9b49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:47:55.699595 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:47:55.699595 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 10 16:47:55.720808 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-7ad38e40-5a2e-457b-8488-f238bd0d9b49 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.737491 Aug 10 16:47:55.728882 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 10 16:47:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 16:47:55.734511 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-5ad58630-ff1b-4690-b691-7a2ae4ab4c11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:47:55.738261 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:47:55.738261 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: warnings.warn(msg) Aug 10 16:47:55.772868 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-5ad58630-ff1b-4690-b691-7a2ae4ab4c11 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042198 Aug 10 16:47:55.773659 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Aug 10 16:47:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:47:57.962531 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-7ad38e40-5a2e-457b-8488-f238bd0d9b49 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:47:57.963544 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-7ad38e40-5a2e-457b-8488-f238bd0d9b49 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 10 16:47:57.963951 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:47:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:47:58.374761 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-0ebb9459-a17a-4228-92eb-be7dd5e94e76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:47:58.393742 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-0ebb9459-a17a-4228-92eb-be7dd5e94e76 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423389 Aug 10 16:47:58.394295 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 10 16:47:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:47:58.406320 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-684209bd-81cd-4d2b-ada0-bc7478e4eba8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:47:58.432047 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-684209bd-81cd-4d2b-ada0-bc7478e4eba8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029413 Aug 10 16:47:58.432793 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Aug 10 16:47:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:48:00.635603 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-0ebb9459-a17a-4228-92eb-be7dd5e94e76 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:00.636652 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-0ebb9459-a17a-4228-92eb-be7dd5e94e76 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 10 16:48:00.637053 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:48:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:01.113317 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-dff2beea-316f-41d9-99e2-f3548a878245 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:01.132898 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-dff2beea-316f-41d9-99e2-f3548a878245 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489973 Aug 10 16:48:01.133642 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 10 16:48:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 16:48:01.145777 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-96ca5230-b603-47d7-b802-01553a4fd5e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:01.170895 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-96ca5230-b603-47d7-b802-01553a4fd5e9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028792 Aug 10 16:48:01.171470 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Aug 10 16:48:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:48:03.451760 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-dff2beea-316f-41d9-99e2-f3548a878245 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:03.452710 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-dff2beea-316f-41d9-99e2-f3548a878245 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Aug 10 16:48:03.453553 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:48:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:03.926718 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-97ce02a5-287b-449c-ae54-5955dbd1d395 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:03.948433 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-97ce02a5-287b-449c-ae54-5955dbd1d395 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487934 Aug 10 16:48:03.949121 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 10 16:48:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:48:03.968806 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-47c2ed96-421b-40ab-9b8a-f693d76d4a32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:03.995520 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-47c2ed96-421b-40ab-9b8a-f693d76d4a32 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031338 Aug 10 16:48:03.996928 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Aug 10 16:48:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:48:06.275940 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-97ce02a5-287b-449c-ae54-5955dbd1d395 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:06.277603 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-97ce02a5-287b-449c-ae54-5955dbd1d395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002343 Aug 10 16:48:06.278239 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:48:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:06.744027 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-f1480ef0-1d62-42a6-80fe-4c624f378dda admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:06.768979 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-f1480ef0-1d62-42a6-80fe-4c624f378dda admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.483911 Aug 10 16:48:06.769519 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Aug 10 16:48:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:48:09.004176 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-97ce02a5-287b-449c-ae54-5955dbd1d395 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:09.005506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-97ce02a5-287b-449c-ae54-5955dbd1d395 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Aug 10 16:48:09.006131 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:48:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:09.468368 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-62158360-c250-40b5-bb70-730b3366e0f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:09.487577 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-62158360-c250-40b5-bb70-730b3366e0f8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.474075 Aug 10 16:48:09.488170 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 10 16:48:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:48:09.501660 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-8552a22b-a572-4492-beac-caba8658676e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:09.532727 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-8552a22b-a572-4492-beac-caba8658676e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035934 Aug 10 16:48:09.533724 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Aug 10 16:48:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:48:11.727868 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-62158360-c250-40b5-bb70-730b3366e0f8 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:11.728901 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-62158360-c250-40b5-bb70-730b3366e0f8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 10 16:48:11.729305 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:48:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:12.131756 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d761e7a5-5123-44ca-b638-2b0920501ded admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:12.150312 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d761e7a5-5123-44ca-b638-2b0920501ded admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414870 Aug 10 16:48:12.158207 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 10 16:48:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 16:48:12.163750 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-bf09ccc0-d578-42ad-bb04-416d8d858e0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:12.187376 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-bf09ccc0-d578-42ad-bb04-416d8d858e0e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027511 Aug 10 16:48:12.188092 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Aug 10 16:48:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:48:14.422077 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d761e7a5-5123-44ca-b638-2b0920501ded admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:14.423082 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d761e7a5-5123-44ca-b638-2b0920501ded admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 10 16:48:14.423480 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:48:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:14.817568 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-53f6abaf-9e5c-45f7-88a1-33aaaaf8526f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "swap": 0, "disk": 40, "ram": 4096, "name": "m1.medium"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:14.839031 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-53f6abaf-9e5c-45f7-88a1-33aaaaf8526f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.408801 Aug 10 16:48:14.839577 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 10 16:48:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:48:14.852103 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-86f36b1b-4715-4c43-b88f-7d2a907f3038 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:14.877219 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-86f36b1b-4715-4c43-b88f-7d2a907f3038 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028653 Aug 10 16:48:14.877860 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Aug 10 16:48:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:48:17.173252 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-53f6abaf-9e5c-45f7-88a1-33aaaaf8526f admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:17.174838 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-53f6abaf-9e5c-45f7-88a1-33aaaaf8526f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Aug 10 16:48:17.175230 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:48:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:17.666768 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-762e4505-d463-4eed-af7d-51d82452487b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "id": "4"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:17.690715 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-762e4505-d463-4eed-af7d-51d82452487b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.509480 Aug 10 16:48:17.691723 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 10 16:48:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:48:17.703968 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-097778bd-9563-4d42-bd86-207f96e26e5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:17.729932 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-097778bd-9563-4d42-bd86-207f96e26e5d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029996 Aug 10 16:48:17.730614 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Aug 10 16:48:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:48:19.987951 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-762e4505-d463-4eed-af7d-51d82452487b admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:19.988896 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-762e4505-d463-4eed-af7d-51d82452487b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Aug 10 16:48:19.989308 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:48:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:20.469200 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-854fa30e-4ee6-4e5d-9754-573bd27f3ce4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "ram": 16384}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:20.490638 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-854fa30e-4ee6-4e5d-9754-573bd27f3ce4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.495213 Aug 10 16:48:20.491528 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Aug 10 16:48:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 16:48:20.503681 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-6d106e32-bb6d-471f-8e48-793d570f76c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:20.508487 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:20.533941 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-6d106e32-bb6d-471f-8e48-793d570f76c5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033597 Aug 10 16:48:20.534716 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Aug 10 16:48:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:48:41.012109 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-854fa30e-4ee6-4e5d-9754-573bd27f3ce4 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:41.013330 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-854fa30e-4ee6-4e5d-9754-573bd27f3ce4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Aug 10 16:48:41.013731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:48:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:41.464096 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-7a235150-b0d7-43fe-a541-a1f36b6b2567 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:41.483140 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-7a235150-b0d7-43fe-a541-a1f36b6b2567 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.462722 Aug 10 16:48:41.483689 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Aug 10 16:48:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:48:42.609040 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-854fa30e-4ee6-4e5d-9754-573bd27f3ce4 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:42.610045 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-854fa30e-4ee6-4e5d-9754-573bd27f3ce4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 10 16:48:42.610446 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:43.186510 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-572879b9-40dc-4058-a975-e430a72e8bf0 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:43.192991 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.wsgi [None req-572879b9-40dc-4058-a975-e430a72e8bf0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-572879b9-40dc-4058-a975-e430a72e8bf0 admin admin] Request method failure captured: Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Accept: application/json Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Accept-Encoding: gzip, deflate Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Connection: keep-alive Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Content-Length: 0 Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Host: 10.222.0.25 Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Openstack-Api-Version: compute 2.90 Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Openstack-System-Scope: None Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: User-Agent: python-novaclient Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Auth-Token: gAAAAABi8-FqpNRFUXqlBmqK9MLT9FmgHPUXty_KXwd62afVOt8L6bfmT5dF1AvTQhtbPaeEUjetcbbzh4YHv53VA6xHB7P49bvxrEOqHyfkmucrAXr75YvYN0zU0FCVu3bur2Tg8UvroVDrQZHper9WFOW0vvGtdNXJ3-AgnAjxtJ1SzMaQuhM Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Domain-Id: None Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Domain-Name: None Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Identity-Status: Confirmed Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Is-Admin-Project: True Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Domain-Id: default Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Domain-Name: Default Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Name: admin Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Role: admin,reader,member Aug 10 16:48:43.196297 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Roles: admin,reader,member Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c8b317543504cf3bafa443bc2186b42", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Tenant: admin Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Tenant-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Tenant-Name: admin Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User: admin Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Domain-Id: default Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Domain-Name: Default Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Id: b68f518c53f84700bf1f6ef1bd005525 Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Name: admin Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: method: > Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: exception: Flavor 42 could not be found. Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: action_args: {'id': '42'} Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:48:43.199013 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:43.201193 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:43.203580 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-572879b9-40dc-4058-a975-e430a72e8bf0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:48:43.207030 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-572879b9-40dc-4058-a975-e430a72e8bf0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.446870 Aug 10 16:48:43.207030 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Aug 10 16:48:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 16:48:43.211807 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-8cdcfea5-a245-458f-b592-702c12a2489e admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:43.216025 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:43.235902 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-8cdcfea5-a245-458f-b592-702c12a2489e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028422 Aug 10 16:48:43.236983 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 10 16:48:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:48:43.246871 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-8e34ccb2-7360-4659-bdfa-2068951020df admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:43.272276 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-8e34ccb2-7360-4659-bdfa-2068951020df admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028862 Aug 10 16:48:43.272837 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 10 16:48:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:48:43.282999 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a4310c3c-a3eb-4e86-8170-bf63482db2c4 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:43.289441 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-a4310c3c-a3eb-4e86-8170-bf63482db2c4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a4310c3c-a3eb-4e86-8170-bf63482db2c4 admin admin] Request method failure captured: Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Accept: application/json Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Connection: keep-alive Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Content-Length: 0 Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Host: 10.222.0.25 Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.90 Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABi8-FqpNRFUXqlBmqK9MLT9FmgHPUXty_KXwd62afVOt8L6bfmT5dF1AvTQhtbPaeEUjetcbbzh4YHv53VA6xHB7P49bvxrEOqHyfkmucrAXr75YvYN0zU0FCVu3bur2Tg8UvroVDrQZHper9WFOW0vvGtdNXJ3-AgnAjxtJ1SzMaQuhM Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Role: admin,reader,member Aug 10 16:48:43.292731 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Roles: admin,reader,member Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c8b317543504cf3bafa443bc2186b42", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Tenant: admin Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Tenant-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User: admin Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Id: b68f518c53f84700bf1f6ef1bd005525 Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Name: admin Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: method: > Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: exception: Flavor 42 could not be found. Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: action_args: {'id': '42'} Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:48:43.294247 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:43.295104 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:43.296504 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a4310c3c-a3eb-4e86-8170-bf63482db2c4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:48:43.297728 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a4310c3c-a3eb-4e86-8170-bf63482db2c4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015409 Aug 10 16:48:43.297728 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Aug 10 16:48:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 16:48:44.318828 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-8e34ccb2-7360-4659-bdfa-2068951020df admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:44.319846 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-8e34ccb2-7360-4659-bdfa-2068951020df admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 10 16:48:44.320270 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:44.935551 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-edb0a080-b20b-4912-8413-13e4fb5c82bc admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:44.941412 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-edb0a080-b20b-4912-8413-13e4fb5c82bc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-edb0a080-b20b-4912-8413-13e4fb5c82bc admin admin] Request method failure captured: Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Accept: application/json Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Connection: keep-alive Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Content-Length: 0 Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Host: 10.222.0.25 Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.90 Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABi8-FsYmMR-SrbdIURImzWuobNyIQsB_O60JXyq6sHUjsDOVZderld8RUFyyOYeTZyK9NBu5QORfCDRPnkxP24kUU_9auRGZdC9gLQxwUjIrVoGYJdkMVbWfpJabrL7G7rYANcRD9Zr1E0_zgoHbvv4TxEa3Qerhf8tKkYEY8Rk6Ox_z0 Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Role: admin,reader,member Aug 10 16:48:44.943020 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Roles: admin,reader,member Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c8b317543504cf3bafa443bc2186b42", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Tenant: admin Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Tenant-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User: admin Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Id: b68f518c53f84700bf1f6ef1bd005525 Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Name: admin Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: method: > Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: exception: Flavor 84 could not be found. Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: action_args: {'id': '84'} Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:48:44.944374 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:44.947074 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:44.948311 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-edb0a080-b20b-4912-8413-13e4fb5c82bc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:48:44.949327 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-edb0a080-b20b-4912-8413-13e4fb5c82bc admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.480792 Aug 10 16:48:44.949327 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Aug 10 16:48:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 482 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 16:48:44.954968 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-085053be-c0ee-479c-be0a-68bc251751b8 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:44.970460 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-085053be-c0ee-479c-be0a-68bc251751b8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019202 Aug 10 16:48:44.971411 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 10 16:48:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:48:44.982998 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-354a5e92-bb1a-443c-9c8b-5a6ca3e6c908 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:45.000001 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-354a5e92-bb1a-443c-9c8b-5a6ca3e6c908 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020447 Aug 10 16:48:45.000638 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 10 16:48:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:48:45.011404 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-6f2b6593-5d1c-4208-a07e-065169cf920b admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:45.016990 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.wsgi [None req-6f2b6593-5d1c-4208-a07e-065169cf920b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-6f2b6593-5d1c-4208-a07e-065169cf920b admin admin] Request method failure captured: Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Accept: application/json Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Accept-Encoding: gzip, deflate Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Connection: keep-alive Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Content-Length: 0 Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Host: 10.222.0.25 Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Openstack-Api-Version: compute 2.90 Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Openstack-System-Scope: None Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: User-Agent: python-novaclient Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Auth-Token: gAAAAABi8-FsYmMR-SrbdIURImzWuobNyIQsB_O60JXyq6sHUjsDOVZderld8RUFyyOYeTZyK9NBu5QORfCDRPnkxP24kUU_9auRGZdC9gLQxwUjIrVoGYJdkMVbWfpJabrL7G7rYANcRD9Zr1E0_zgoHbvv4TxEa3Qerhf8tKkYEY8Rk6Ox_z0 Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Domain-Id: None Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Domain-Name: None Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Identity-Status: Confirmed Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Is-Admin-Project: True Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Domain-Id: default Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Domain-Name: Default Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Name: admin Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Role: admin,reader,member Aug 10 16:48:45.018745 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Roles: admin,reader,member Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c8b317543504cf3bafa443bc2186b42", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Tenant: admin Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Tenant-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Tenant-Name: admin Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User: admin Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Domain-Id: default Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Domain-Name: Default Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Id: b68f518c53f84700bf1f6ef1bd005525 Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Name: admin Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: method: > Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: exception: Flavor 84 could not be found. Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: action_args: {'id': '84'} Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:48:45.020305 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:45.021243 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:45.022506 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-6f2b6593-5d1c-4208-a07e-065169cf920b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:48:45.023737 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-6f2b6593-5d1c-4208-a07e-065169cf920b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012384 Aug 10 16:48:45.023737 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Aug 10 16:48:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 16:48:46.033992 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-354a5e92-bb1a-443c-9c8b-5a6ca3e6c908 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:46.034991 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-354a5e92-bb1a-443c-9c8b-5a6ca3e6c908 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 10 16:48:46.035391 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:46.601040 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-24c8c9bf-2784-4e73-95c6-93e3ad03b614 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:46.607203 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.wsgi [None req-24c8c9bf-2784-4e73-95c6-93e3ad03b614 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-24c8c9bf-2784-4e73-95c6-93e3ad03b614 admin admin] Request method failure captured: Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Accept: application/json Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Accept-Encoding: gzip, deflate Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Connection: keep-alive Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Content-Length: 0 Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Host: 10.222.0.25 Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Openstack-Api-Version: compute 2.90 Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Openstack-System-Scope: None Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: User-Agent: python-novaclient Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Auth-Token: gAAAAABi8-FtNbO82W_EhoGsA9k3YVa-9PCZjAvsMqEY7kduS7l1lvwoMJQdc9oXxtnQCLGXOH1HBfCB-Pvb5yu29DY1N80qexThECwxzzUvA0b-ofDV6b-SlKm6ez2ZoXkYt__Gi-iBhb2AuxDjJmT3sftqzlppZ8dW_D1qk03CfOkgB92MHwY Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Domain-Id: None Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Domain-Name: None Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Identity-Status: Confirmed Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Is-Admin-Project: True Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Domain-Id: default Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Domain-Name: Default Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Project-Name: admin Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Role: admin,reader,member Aug 10 16:48:46.608783 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Roles: admin,reader,member Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c8b317543504cf3bafa443bc2186b42", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Tenant: admin Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Tenant-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-Tenant-Name: admin Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User: admin Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Domain-Id: default Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Domain-Name: Default Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Id: b68f518c53f84700bf1f6ef1bd005525 Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: X-User-Name: admin Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: method: > Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: exception: Flavor 451 could not be found. Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: action_args: {'id': '451'} Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:48:46.611224 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:46.612041 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 10 16:48:46.613184 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-24c8c9bf-2784-4e73-95c6-93e3ad03b614 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:48:46.614795 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-24c8c9bf-2784-4e73-95c6-93e3ad03b614 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.438141 Aug 10 16:48:46.614795 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 10 16:48:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 16:48:46.622376 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-f074b0f4-fb71-49c2-88c8-2d67d2c62515 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:46.638694 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-f074b0f4-fb71-49c2-88c8-2d67d2c62515 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021232 Aug 10 16:48:46.639264 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 10 16:48:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:48:46.649033 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:46.664747 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019196 Aug 10 16:48:46.665314 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Aug 10 16:48:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:48:46.675371 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-0f8b69cb-61f3-409f-917b-0f1a6584d166 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:46.680824 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-0f8b69cb-61f3-409f-917b-0f1a6584d166 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-0f8b69cb-61f3-409f-917b-0f1a6584d166 admin admin] Request method failure captured: Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Accept: application/json Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Connection: keep-alive Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Content-Length: 0 Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Host: 10.222.0.25 Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.90 Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABi8-FtNbO82W_EhoGsA9k3YVa-9PCZjAvsMqEY7kduS7l1lvwoMJQdc9oXxtnQCLGXOH1HBfCB-Pvb5yu29DY1N80qexThECwxzzUvA0b-ofDV6b-SlKm6ez2ZoXkYt__Gi-iBhb2AuxDjJmT3sftqzlppZ8dW_D1qk03CfOkgB92MHwY Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Role: admin,reader,member Aug 10 16:48:46.682352 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Roles: admin,reader,member Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c8b317543504cf3bafa443bc2186b42", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c8b317543504cf3bafa443bc2186b42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Tenant: admin Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Tenant-Id: 6c8b317543504cf3bafa443bc2186b42 Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User: admin Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Id: b68f518c53f84700bf1f6ef1bd005525 Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: X-User-Name: admin Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: method: > Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: exception: Flavor 451 could not be found. Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: action_args: {'id': '451'} Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:48:46.683919 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:46.685002 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 10 16:48:46.686132 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-0f8b69cb-61f3-409f-917b-0f1a6584d166 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:48:46.687130 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-0f8b69cb-61f3-409f-917b-0f1a6584d166 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012514 Aug 10 16:48:46.687130 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 10 16:48:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 16:48:47.699511 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:47.700547 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 10 16:48:47.700937 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:48:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:48.262241 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-279c0b1b-fbad-4233-827d-84b44fe3d25a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:48.283321 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-279c0b1b-fbad-4233-827d-84b44fe3d25a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.442413 Aug 10 16:48:48.283874 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Aug 10 16:48:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:48:49.301532 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:49.302543 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 10 16:48:49.302943 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:49.864372 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-ba0f1179-649e-4d6a-9e2a-fc23588b9fb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:49.883738 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-ba0f1179-649e-4d6a-9e2a-fc23588b9fb3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.440130 Aug 10 16:48:49.884741 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Aug 10 16:48:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:48:50.896696 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:50.897703 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 10 16:48:50.898104 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:51.459236 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-560a7383-3326-4028-89ae-96a2051f6ddf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:51.480775 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-560a7383-3326-4028-89ae-96a2051f6ddf admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.432740 Aug 10 16:48:51.481329 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Aug 10 16:48:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:48:52.472768 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:52.473770 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 10 16:48:52.474168 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:48:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:53.015355 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-d6ec7a92-34c2-46b9-bc46-58e734d6a3a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:48:53.034879 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-d6ec7a92-34c2-46b9-bc46-58e734d6a3a6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.420624 Aug 10 16:48:53.035432 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Aug 10 16:48:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:48:54.046088 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:54.047159 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 10 16:48:54.047562 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:48:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:48:54.611945 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-3d4fd2ba-15c5-4e33-b14b-6e3ed1bd387f admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:48:54.633500 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-3d4fd2ba-15c5-4e33-b14b-6e3ed1bd387f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.446472 Aug 10 16:48:54.634089 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Wed Aug 10 16:48:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:49:47.575540 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:49:47.576576 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-fcfdbcb4-1266-48ea-95b5-1fe174564313 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Aug 10 16:49:47.576976 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Wed Aug 10 16:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:49:47.588042 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:48.013998 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-20488bf0-2f6c-4a10-8dea-4abf7b854de4 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:49:48.035770 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-20488bf0-2f6c-4a10-8dea-4abf7b854de4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.452144 Aug 10 16:49:48.036353 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Aug 10 16:49:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:49:48.057715 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:48.061896 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-3fa697ce-01f6-4d28-9b1e-f18ad4dae65a admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:49:48.070467 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-3fa697ce-01f6-4d28-9b1e-f18ad4dae65a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014131 Aug 10 16:49:48.071029 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Wed Aug 10 16:49:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:48.084237 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-5856dd25-f77e-4462-bde2-0c31b57d8fa3 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:49:48.092077 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-5856dd25-f77e-4462-bde2-0c31b57d8fa3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011773 Aug 10 16:49:48.092668 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Wed Aug 10 16:49:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:48.105697 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-cd796d27-4b86-4326-ac6b-a8aa5339ed9a admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:49:48.115197 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-cd796d27-4b86-4326-ac6b-a8aa5339ed9a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013530 Aug 10 16:49:48.115752 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Wed Aug 10 16:49:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:48.128284 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-3416952a-d851-473a-8e40-fb8162fb6d15 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:49:48.136324 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-3416952a-d851-473a-8e40-fb8162fb6d15 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012261 Aug 10 16:49:48.136879 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Wed Aug 10 16:49:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:52:42.913934 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-cd796d27-4b86-4326-ac6b-a8aa5339ed9a admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:52:42.914935 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-cd796d27-4b86-4326-ac6b-a8aa5339ed9a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 10 16:52:42.915328 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:52:43.057891 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=6 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:43.215724 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-1bb3d475-e50e-4204-91b0-50438dc2f970 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:52:43.218153 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:52:43.218153 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 10 16:52:43.219915 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-1bb3d475-e50e-4204-91b0-50438dc2f970 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:52:43.220425 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-1bb3d475-e50e-4204-91b0-50438dc2f970 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:52:43.220835 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-1bb3d475-e50e-4204-91b0-50438dc2f970 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:52:43.221543 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-1bb3d475-e50e-4204-91b0-50438dc2f970 admin admin] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:52:43.221984 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-1bb3d475-e50e-4204-91b0-50438dc2f970 admin admin] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:52:43.222399 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-1bb3d475-e50e-4204-91b0-50438dc2f970 admin admin] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:52:43.256180 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-1bb3d475-e50e-4204-91b0-50438dc2f970 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199857 Aug 10 16:52:43.256734 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 10 16:52:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:52:44.148572 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-cd796d27-4b86-4326-ac6b-a8aa5339ed9a admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:52:44.149678 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-cd796d27-4b86-4326-ac6b-a8aa5339ed9a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002309 Aug 10 16:52:44.150087 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:52:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:52:44.347171 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-2fe8fa5f-182f-4576-b569-b8f3cc3c8301 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:52:44.349598 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:52:44.349598 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 10 16:52:44.350699 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-2fe8fa5f-182f-4576-b569-b8f3cc3c8301 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:52:44.351183 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-2fe8fa5f-182f-4576-b569-b8f3cc3c8301 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:52:44.351613 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-2fe8fa5f-182f-4576-b569-b8f3cc3c8301 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:52:44.352468 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-2fe8fa5f-182f-4576-b569-b8f3cc3c8301 admin admin] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:52:44.352812 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-2fe8fa5f-182f-4576-b569-b8f3cc3c8301 admin admin] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:52:44.353246 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-2fe8fa5f-182f-4576-b569-b8f3cc3c8301 admin admin] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:52:44.373317 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-2fe8fa5f-182f-4576-b569-b8f3cc3c8301 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079608 Aug 10 16:52:44.373879 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 10 16:52:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:52:55.591812 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-cd796d27-4b86-4326-ac6b-a8aa5339ed9a admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:52:55.592852 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-cd796d27-4b86-4326-ac6b-a8aa5339ed9a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 10 16:52:55.593249 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:52:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:52:55.741987 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell0:SELECT=4 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:55.742700 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell1:SELECT=4 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:55.743298 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=8 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:55.790886 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-fe863ee0-de33-4c35-a746-1ec02e6ddfe7 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:52:55.793350 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:52:55.793350 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 10 16:52:55.794445 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-fe863ee0-de33-4c35-a746-1ec02e6ddfe7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:52:55.794921 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-fe863ee0-de33-4c35-a746-1ec02e6ddfe7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:52:55.795395 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-fe863ee0-de33-4c35-a746-1ec02e6ddfe7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:52:55.796091 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-fe863ee0-de33-4c35-a746-1ec02e6ddfe7 admin admin] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:52:55.796564 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-fe863ee0-de33-4c35-a746-1ec02e6ddfe7 admin admin] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:52:55.796980 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-fe863ee0-de33-4c35-a746-1ec02e6ddfe7 admin admin] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:52:55.822365 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-fe863ee0-de33-4c35-a746-1ec02e6ddfe7 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084881 Aug 10 16:52:55.822935 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 10 16:52:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:52:56.657412 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-cd796d27-4b86-4326-ac6b-a8aa5339ed9a admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:52:56.658406 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-cd796d27-4b86-4326-ac6b-a8aa5339ed9a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Aug 10 16:52:56.658831 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Aug 10 16:52:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:52:56.850583 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-7c3ff4ae-4463-4165-83c8-ba36e45405d6 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:52:56.852978 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:52:56.852978 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 10 16:52:56.854072 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-7c3ff4ae-4463-4165-83c8-ba36e45405d6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:52:56.854574 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-7c3ff4ae-4463-4165-83c8-ba36e45405d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:52:56.855001 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-7c3ff4ae-4463-4165-83c8-ba36e45405d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:52:56.855711 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-7c3ff4ae-4463-4165-83c8-ba36e45405d6 admin admin] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:52:56.856235 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-7c3ff4ae-4463-4165-83c8-ba36e45405d6 admin admin] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:52:56.856656 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-7c3ff4ae-4463-4165-83c8-ba36e45405d6 admin admin] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:52:56.877619 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-7c3ff4ae-4463-4165-83c8-ba36e45405d6 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078217 Aug 10 16:52:56.878158 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Aug 10 16:52:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:53:59.247339 dv-cinder-836027-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 16:53:59.247955 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: Wed Aug 10 16:53:59 2022 - graceful shutdown triggered... Aug 10 16:53:59.248410 dv-cinder-836027-6-iscsi devstack@n-api.service[105502]: Gracefully killing worker 1 (pid: 105502)... Aug 10 16:53:59.248766 dv-cinder-836027-6-iscsi devstack@n-api.service[105503]: Gracefully killing worker 2 (pid: 105503)... Aug 10 16:54:00.248299 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: worker 1 buried after 1 seconds Aug 10 16:54:00.248847 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: worker 2 buried after 1 seconds Aug 10 16:54:00.248847 dv-cinder-836027-6-iscsi devstack@n-api.service[105501]: goodbye to uWSGI. Aug 10 16:54:00.249864 dv-cinder-836027-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 16:54:00.250414 dv-cinder-836027-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 16:54:00.253234 dv-cinder-836027-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 16:54:00.262353 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 16:54:00 2022] *** Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: nodename: dv-cinder-836027-6-iscsi Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: machine: x86_64 Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: clock source: unix Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: pcre jit disabled Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: detected number of CPU cores: 4 Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: current working directory: / Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: detected binary path: /usr/bin/uwsgi-core Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: your processes number limit is 47680 Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: your memory page size is 4096 bytes Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: detected max file descriptor number: 2048 Aug 10 16:54:00.265597 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: lock engine: pthread robust mutexes Aug 10 16:54:00.266677 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: thunder lock: enabled Aug 10 16:54:00.266677 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 16:54:00.266677 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 16:54:00.304743 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: Python main interpreter initialized at 0x5557a6bdc9c0 Aug 10 16:54:00.305059 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: python threads support enabled Aug 10 16:54:00.305216 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: your server socket listen backlog is limited to 100 connections Aug 10 16:54:00.305353 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: your mercy for graceful operations on workers is 90 seconds Aug 10 16:54:00.305808 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 16:54:00.306063 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: *** Operational MODE: preforking *** Aug 10 16:54:00.306527 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: *** uWSGI is running in multiple interpreter mode *** Aug 10 16:54:00.306698 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: spawned uWSGI master process (pid: 120594) Aug 10 16:54:00.307132 dv-cinder-836027-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 16:54:00.307849 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: spawned uWSGI worker 1 (pid: 120608, cores: 1) Aug 10 16:54:00.328114 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: spawned uWSGI worker 2 (pid: 120614, cores: 1) Aug 10 16:54:00.328114 dv-cinder-836027-6-iscsi devstack@n-api.service[120594]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 16:54:00.984974 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 16:54:00.986363 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 16:54:02.164920 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:54:02.164920 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: from cryptography.utils import int_from_bytes Aug 10 16:54:02.165654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:54:02.165654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: from cryptography.utils import int_from_bytes Aug 10 16:54:02.183619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:54:02.183619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: from cryptography.utils import int_from_bytes Aug 10 16:54:02.184251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:54:02.184251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: from cryptography.utils import int_from_bytes Aug 10 16:54:04.501622 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 16:54:04.502160 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 16:54:04.502608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 16:54:04.502977 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 16:54:04.503236 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 16:54:04.503627 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.503957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.504327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.504746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.505133 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.506738 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.507078 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.507410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.507746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.508013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.508365 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.508698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-6-iscsi {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.509026 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.509340 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.509653 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.509979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.511457 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.511796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.512117 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.512654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.513117 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.513461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.516058 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.516058 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.516058 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.516058 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.516460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.516665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.516932 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.517252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.517665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-6-iscsi {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.517988 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.518307 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.518626 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.519057 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.519377 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.520889 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.521238 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.521579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.521899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.522249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.522581 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.522910 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.523244 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.523553 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.523868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.524207 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.524536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.524849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.525160 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.525417 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.525730 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.526056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.526385 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.526716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.526980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.527239 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.527550 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.527872 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.528205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.528519 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.529343 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.529659 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.529971 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.530285 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.530585 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.530893 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.531214 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.531533 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.531856 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.532191 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.532521 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.532929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.533182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.533497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.533841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.534160 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.534469 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.534788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.535109 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.535416 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.535593 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 16:54:04.536018 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.536101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 16:54:04.536229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.536396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.536513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 16:54:04.536689 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.536843 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 16:54:04.536994 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 16:54:04.537141 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.537303 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.537465 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.537618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.537762 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.537900 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.538041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.538182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.538325 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.538463 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.538595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.538683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.538883 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.538997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.539199 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.539300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.539516 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.539609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.539841 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.539941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.540101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.540241 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.540461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.540600 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.540768 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.540911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-6-iscsi {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.541073 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.541213 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.541379 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.541514 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.541683 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.541825 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.541986 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.542088 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.542293 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.542383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.542612 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.542714 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.542913 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.543015 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.543216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.543416 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.543537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.543730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.543830 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.544034 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.544198 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.544368 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.544534 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.545248 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.545378 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.545563 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.545683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.545869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.545996 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.546171 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.546347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.546464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.546582 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.546781 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.546899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.547084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.547229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.547399 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.547493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-6-iscsi {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.547702 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.547798 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.548009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.548102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.548351 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.548445 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.548659 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.548791 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.548964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.549101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.549268 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.549408 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.549572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.549727 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.549875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.550049 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.550180 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.550354 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.550480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.550686 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.550778 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.551005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.551097 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.551322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.551420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.551643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.551775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.552028 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.552129 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.552273 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.552405 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.552584 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.552684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.552903 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.553000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.553242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.553467 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.553560 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.553650 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.553812 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.553905 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.554122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.554226 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.554450 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.554572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.554771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.554875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.555092 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.555200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.555346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.555451 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.555597 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.555748 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.555915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.556074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.556260 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.556422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.556570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.556735 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.556877 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.557047 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.557183 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.557364 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.557489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.557683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.557832 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.558013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.558113 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.558334 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.558433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.558650 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.558743 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.558968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.559060 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.559277 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.559379 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.559593 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.559691 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.559900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.560002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.560269 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.560379 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.560652 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.560805 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.560940 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.561076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.561214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.561343 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.561521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.561617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.561838 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.561974 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.562146 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.562292 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.562462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.562604 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.562779 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.562872 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.563085 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.563191 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.563392 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.563484 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.563694 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.563795 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.564010 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.564116 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.564366 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.564459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.564670 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.564762 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.564921 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.565022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.565221 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.565322 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.565523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.565625 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.565837 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.565929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.566141 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.566232 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.566450 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.566580 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.566746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.566843 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.567045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.567147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.567387 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.567506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.567701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.567865 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.568007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.568097 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.568336 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.568432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.568638 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.568736 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.568941 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.569087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.569244 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.569388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.569547 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.569646 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.569850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.569947 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.570162 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.570273 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.570478 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.570571 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.570782 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.570882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.571085 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.571190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.571387 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.571511 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.571693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.571805 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.571998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.572139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.572325 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.572627 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.572729 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.572938 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.573031 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.573242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.573332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.573543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.573694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.573835 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.573973 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.574149 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.574282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.574452 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.574585 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.574756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.574897 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.575053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.575152 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.575358 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.575460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.575692 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.575806 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.576088 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.576255 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.576421 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.576575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.576725 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.576818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.577028 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.577120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.577330 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.577432 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.577632 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.577745 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.577935 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.578082 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.578221 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.578324 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.578517 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.578609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.578832 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.578930 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.579149 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.579322 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.579458 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.579546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.579750 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.579843 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.580052 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.580167 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.580391 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:54:04.580495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.580715 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.580807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.581021 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.581167 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.581327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.581427 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.581632 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.581724 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.582195 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.582301 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.582498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.582601 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.582804 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.582938 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.583109 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.583250 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.583416 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.583519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.583720 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.583828 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.584042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.584137 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.584378 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.584471 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.584684 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.584794 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.584985 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.585083 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.585288 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.585379 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.585630 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.585732 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.585937 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.586039 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.586265 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.586363 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.586599 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.586701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.586939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.587046 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.587208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.587301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.587526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.587617 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.587842 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.587955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.588171 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.588317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.588488 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.588594 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.588803 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.588939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.589116 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.589216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.589440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.589575 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.589754 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.589859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.590059 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.590158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.590370 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.590462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.590681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.590780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.590995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.591095 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.591834 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.591931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.592170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.592279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.592485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.592591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.592799 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.592900 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.593111 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.593211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.593426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.593527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.593737 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.593829 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.594047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.594138 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.594367 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.594467 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.594678 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.594812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.594986 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.595119 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.595294 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.595436 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.595605 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.595697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.595914 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.596003 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.596244 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.596341 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.596556 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.596679 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.596860 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.596997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.597166 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.597260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.597473 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.597573 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.597783 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.597883 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.598084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.598191 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.598402 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.598506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.598721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.598819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.599026 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.599127 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.599346 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.599489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.599649 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.599755 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.599957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.600057 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.600288 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.600396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.600597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.600697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.600896 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.600987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.601197 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.601287 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.601500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.601606 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.601800 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.601898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.602110 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.602201 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.602418 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.602520 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.602722 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.602815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.603024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.603115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.603333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.603425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.603640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.603744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.603941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.604038 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.604270 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.604377 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.604580 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.604671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.604888 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.604986 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.605195 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.605339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.605511 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.605610 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.605822 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.605914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.606122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.606214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.606425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.606518 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.606745 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.606849 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.607598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.607700 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.607902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.608024 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.608226 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.608452 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.608558 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.608696 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.608862 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.609000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.609175 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.609350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.609485 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.609632 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.609805 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.609905 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.610127 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.610230 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.610438 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.610538 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.610756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.610856 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.611056 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.611147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.611358 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.611450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.611659 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.611751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.611961 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.612061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.612297 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.612390 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.612604 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.612705 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.612909 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.613009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.613215 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.613314 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.613516 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.613609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.613840 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.613932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.614144 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.614235 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.614451 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.614551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.614763 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.614855 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.615069 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.615160 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.615380 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.615527 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.615698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.615799 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.616010 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.616308 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.616404 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.616643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.616738 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.616951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.617042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.617261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.617361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.617579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.617671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.617886 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.617980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.618204 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.618310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.618558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.618672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.618830 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.618923 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.619143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.619249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.619454 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.619551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.619754 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.619858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.620057 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.620207 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.620393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.620487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.620700 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.620793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.621005 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.621096 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.621310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.621403 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.621620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.621713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.621925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.622017 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.622231 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.622329 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.622548 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.622650 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.622863 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.622998 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.623178 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.623269 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.623487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.623587 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.623798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.623890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.624102 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.624226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.624448 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.624542 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.624757 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.624858 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.625061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.625162 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.625365 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.625458 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.625668 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.625755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.625978 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.626085 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.626304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.626394 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.626629 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.626737 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.626937 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.627038 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.627246 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.627339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.627568 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.627662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.627871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.628171 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.628267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.628501 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.628622 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.628826 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.628931 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.629101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.629195 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.629401 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.629499 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.629706 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.629811 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.630009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.630112 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.630319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.630454 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.630629 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.630740 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.630938 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.631038 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.631247 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.631346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.631549 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.631682 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.631849 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.631967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.632209 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.632319 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.632488 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.632576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.632786 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.632879 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.633089 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.633178 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.633400 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.633493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.633711 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.633805 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.634010 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.634147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.634310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.634402 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.634620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.634719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.634923 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.635029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.635225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.635319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.635525 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.635617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.635826 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.635969 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.636129 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.636260 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.636459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.636559 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.636768 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.636876 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.637070 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.637170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.637388 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.637479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.637695 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.637795 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.638001 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.638093 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.638331 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.638431 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.638638 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.638736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.638947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.639043 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.639233 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.639327 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.639540 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.639633 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.639859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.640186 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.640282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.640491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.640598 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.640800 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.640893 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.641105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.641198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.641410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.641521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.641712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.641812 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.642018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.642108 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.642316 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.642408 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.642619 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.642718 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.642922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.643022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.643232 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.643333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.643535 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.643793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.643892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.644125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.644266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.644463 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.644564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.644763 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.644853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.645065 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.645167 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.645392 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.645483 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.645698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.645795 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.646057 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.646197 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.646363 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.646456 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.646677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.646785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.646997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.647089 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.647307 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.647410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.647614 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.647712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.647923 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.648024 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.648251 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.648367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.648558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.648649 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.648862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.649075 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.649171 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.649266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.649462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.649556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.649763 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.649862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.650063 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.650205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.650355 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.650445 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.650664 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.650764 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.650965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.651071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.651274 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.651374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.651578 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.651678 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.651894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.651994 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.652221 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.652317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.652530 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.652635 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.652832 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.652925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.653133 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.653228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.653440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.653530 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.653751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.654383 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.654602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.654696 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.654913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.655005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.655225 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.655317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.655536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.655636 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.655842 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.655948 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.656222 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.656331 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.656483 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.656576 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.656792 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.656899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.657110 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.657248 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.657419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.657521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.657722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.657822 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.658024 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.658124 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.658327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.658460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.658634 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.658734 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.658938 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.659045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.659245 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.659376 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.659544 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.659687 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.659851 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.660000 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.660167 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.660338 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.660542 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.660646 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.660782 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.660946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.661126 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.661262 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.661460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.661579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.661772 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.661886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.662080 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.662305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.662412 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.662621 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.662728 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.662940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.663040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.663254 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.663357 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.663561 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.663655 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.663861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.663959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.664205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.664316 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.664496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.664597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.664804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.664896 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.665105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.665204 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.665413 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.665513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.665717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.665808 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.666018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.666118 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.666321 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.666467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.666629 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.666736 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.666929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.667021 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.667233 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.667332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.667539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.667732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.667860 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.668044 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.668198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.668380 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.668505 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.668703 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.668804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.669026 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.669117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.669351 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.669510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.670211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.670307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.670530 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.670629 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.670831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.670933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.671132 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.671232 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.671433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.671526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.671736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.671838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.672040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.672133 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.672382 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.672486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.672693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.672794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.672996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.673095 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.673297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.673398 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.673598 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.673701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.673939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.674045 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.674244 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.674336 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.674598 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.674692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.674901 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.674996 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.675213 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.675305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.675530 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.675630 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.675838 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.675994 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.676173 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.676307 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.676479 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.676575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.676788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.676889 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.677113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.677210 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.677421 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.677524 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.677733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.677828 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.678044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.678150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.678349 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.678490 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.678652 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.678751 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.678960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.679068 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.679265 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.679412 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.679580 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.679693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.679898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.680010 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.680239 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.680344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.680580 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.680698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.680866 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.681010 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.681213 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.681330 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.681447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.681544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.681755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.681868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.682064 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.682171 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.682369 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.682474 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.682676 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.682787 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.682983 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.683089 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.683359 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.683466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.683603 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.683711 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.683907 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.684036 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.684256 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.684377 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.684541 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.684651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.684843 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.684944 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.685192 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.685294 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.685501 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.685602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.685804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.685911 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.686113 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.686222 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.686417 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.686518 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.686726 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.686847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.687027 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.687140 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.687359 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.687465 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.687651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.687771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.687957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.688065 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.688360 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.688485 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.688665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.688784 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.688969 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.689069 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.689270 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.689370 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.689582 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.689743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.689885 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.689979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.690205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.690297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.690514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.690617 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.690820 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.690914 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.691123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.691225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.691426 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.691520 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.691768 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.691868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.692074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.692277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.692429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.692533 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.692746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.692839 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.693071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.693164 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.693380 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.693516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.693693 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.693783 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.693995 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.694094 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.694313 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.694412 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.694629 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.694729 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.694944 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.695051 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.695259 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.695352 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.695569 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.695709 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.695886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.696021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.696223 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.696355 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.696544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.696677 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.696999 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.697101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.697321 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.697423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.697625 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.697726 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.697938 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.698041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.698248 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.698343 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.698570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.698663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.698878 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.698973 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.699188 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.699278 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.699499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.699625 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.699803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.699904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.700107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.700222 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.700459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.700559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.700795 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.700899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.701121 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.701213 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.701457 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.701559 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.701776 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.701870 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.702092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.702184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.702406 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.702512 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.702727 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.702820 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.703055 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.703147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.703360 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.703453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.703670 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.703771 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.703976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.704070 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.704304 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.704401 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.704626 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.704728 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.704929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.705020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.705237 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.705337 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.705544 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.705642 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.705853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.705953 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.706156 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.706259 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.706460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.706554 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.706768 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.707133 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.707335 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.707426 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.707657 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.707747 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.707992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.708100 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.708342 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.708446 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.708658 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.708752 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.708966 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.709067 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.709281 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.709384 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.709586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.709802 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.709930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.710120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.710214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.710454 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.710555 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.710782 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.710884 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.711088 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.711186 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.711408 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.711503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.711725 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.711868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.712051 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.712164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.712387 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.712480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.712695 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.712797 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.713008 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.713101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.713318 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.713418 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.713625 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.713764 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.713944 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.714043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.714248 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.714349 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.714550 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.714644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.714857 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.714949 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.715158 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.715250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.715462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.715689 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.715789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.716043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.716162 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.716887 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.716998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.717190 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.717324 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.717492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.717653 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.717812 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.717974 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.718115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.718283 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.718433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.718610 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.718739 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.718920 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.719066 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.719228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.719321 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.719546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.719719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.719847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.719948 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.720195 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.720295 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.720481 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.720589 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.720794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.720898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.721104 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.721204 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.721409 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.721510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.721719 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.721815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.722025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.722117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.722349 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.722451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.722656 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.722750 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.722965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.723065 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.723269 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.723368 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.723582 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.723682 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.723887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.723996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.724215 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.724323 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.724524 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.724617 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.724828 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.725086 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.725190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.725414 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.725506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.725722 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.725812 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.726028 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.726129 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.726335 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.726427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.726636 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.726735 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.726944 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.727045 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.727245 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.727383 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.727567 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.727700 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.727873 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.728009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.728257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.728353 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.728578 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.728684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.728889 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.729215 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.729340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.729532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.729686 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.729842 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.729971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.730189 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.730292 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.730507 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.730647 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.730817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.731043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.731183 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.731376 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.731477 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.731700 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.731804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.732088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.732717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.732947 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.733039 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.733263 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.733357 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.733569 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.733660 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.733875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.734014 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.734184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.734285 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.734494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.734595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.734800 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.734899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.735104 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.735204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.735411 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.735505 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.735716 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.735821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.736022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.736113 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.736360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.736468 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.736671 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.736775 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.736981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.737074 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.737289 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.737379 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.737596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.737689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.737903 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.738011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.738212 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.738414 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.738516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.738728 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.738822 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.739060 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.739160 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.739447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.739548 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.739766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.739867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.740081 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.740205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.740422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.740531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.740733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.740829 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.741038 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.741136 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.741345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.741439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.741651 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.741749 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.741958 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.742060 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.742262 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.742357 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.742583 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.742683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.742885 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.742976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.743184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.743311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.743499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.743624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.743805 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.743946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.744294 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.744403 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.744606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.744699 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.744927 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.745030 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.745250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.745344 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.745561 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.745654 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.745883 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.745991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.746192 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.746286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.746521 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.746612 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.746848 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.746939 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.747156 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.747256 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.747474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.747602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.747813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.747958 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.748103 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.748207 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.748433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.748535 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.748746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.748841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.749056 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.749156 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.749360 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.749453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.749665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.749764 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.749963 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.750058 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.750271 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.750362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.750575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.750658 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.750878 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.750966 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.751179 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.751286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.751484 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.751580 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.751786 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.751884 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.752088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.752320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.752407 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.752491 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.752710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.752811 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.753020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.753122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.753324 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.753432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.753631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.753732 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.753941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.754035 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.754247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.754345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.754551 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.754649 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.754854 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.754948 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.755161 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.755252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.755464 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.755565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.755798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.755899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.756135 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.756247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.756479 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.756570 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.756791 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.756887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.757100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.757191 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.757409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.757514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.757719 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.757811 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.758040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.758187 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.758360 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.758462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.758672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.758893 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.758986 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.759225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.759325 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.759547 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.759643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.759878 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.760022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.760211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.760307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.760523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.760616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.760827 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.760922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.761128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.761225 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.761460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.761556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.761754 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.761856 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.762060 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.762171 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.762367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.762461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.762678 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.762780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.762985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.763092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.763315 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.763418 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.763624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.763723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.763931 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.764031 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.764263 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.764373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.764574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.764668 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.764883 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.764983 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.765186 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.765285 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.765492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.765593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.765807 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.766099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.766192 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.766414 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.766504 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.766732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.766826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.767054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.767182 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.767388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.767504 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.767701 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.767794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.768011 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.768189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.768335 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.768425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.768644 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.768752 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.768957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.769051 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.769266 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.769360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.769585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.769686 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.769913 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.770008 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.770226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.770329 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.770557 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.770655 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.770937 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.771054 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.771143 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 16:54:04.771320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.771645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.771968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.772305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.772632 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.772963 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.773276 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.773600 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.773911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.774244 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.774585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.774913 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.775238 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.775547 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.775852 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.776169 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.776492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.776814 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.777128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.777435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.777742 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.778053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.778359 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.778666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.779962 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.780424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.780803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.781177 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.781419 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.781734 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.782042 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.782351 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.782658 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.782970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.783278 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.783585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.783896 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.784229 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.784614 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.784879 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.785215 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.785534 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.785859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.786175 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.786498 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.786807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.787128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.787451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.787770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.788080 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.788447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.788760 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.789071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.789383 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.789694 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.790003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.790383 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.790645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.790973 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.791282 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.791608 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.791928 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.792275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.792594 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.792905 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.793237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.793550 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.793868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.794183 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.794570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.795003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.795324 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.795640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.795954 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.796299 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.796621 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.796955 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.797283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.797597 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.797925 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.798255 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.798612 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.798931 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.799277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.799606 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.799924 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.800276 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.800585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:54:04.800832 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 16:54:04.925925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO dbcounter [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Registered counter for database nova_api Aug 10 16:54:04.947524 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_db.sqlalchemy.engines [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:54:04.954285 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writer thread running {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:54:04.955422 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO dbcounter [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Registered counter for database nova_api Aug 10 16:54:04.976012 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_db.sqlalchemy.engines [None req-5e900456-5555-4071-89a5-bc1595119603 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:54:04.983533 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writer thread running {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:54:05.010794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.context [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aab5fae-6c58-46b3-86c8-a7c4cff86d61(cell1) {{(pid=120608) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 16:54:05.014928 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:54:05.015406 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:54:05.017016 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:54:05.017738 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:54:05.018182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:54:05.020889 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:54:05.022908 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO dbcounter [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Registered counter for database nova_cell0 Aug 10 16:54:05.027120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO dbcounter [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Registered counter for database nova_cell1 Aug 10 16:54:05.036128 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_db.sqlalchemy.engines [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:54:05.037335 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_db.sqlalchemy.engines [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:54:05.041959 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.context [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aab5fae-6c58-46b3-86c8-a7c4cff86d61(cell1) {{(pid=120614) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 16:54:05.043519 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writer thread running {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:54:05.046643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:54:05.047124 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:54:05.048763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:54:05.049514 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:54:05.049963 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:54:05.052833 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:54:05.054878 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO dbcounter [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Registered counter for database nova_cell0 Aug 10 16:54:05.059011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO dbcounter [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Registered counter for database nova_cell1 Aug 10 16:54:05.066884 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_db.sqlalchemy.engines [None req-5e900456-5555-4071-89a5-bc1595119603 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:54:05.069747 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_db.sqlalchemy.engines [None req-5e900456-5555-4071-89a5-bc1595119603 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:54:05.076929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writer thread running {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:54:05.078203 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writer thread running {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:54:05.180444 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writer thread running {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:54:05.191153 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO dbcounter [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Registered counter for database nova_cell0 Aug 10 16:54:05.198916 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_db.sqlalchemy.engines [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:54:05.203264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writer thread running {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:54:05.223350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO dbcounter [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Registered counter for database nova_cell0 Aug 10 16:54:05.230297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_db.sqlalchemy.engines [None req-5e900456-5555-4071-89a5-bc1595119603 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:54:05.235497 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writer thread running {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:54:05.526348 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: WARNING keystonemiddleware.auth_token [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 16:54:05.534303 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: WARNING keystonemiddleware.auth_token [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 16:54:05.554723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: WARNING keystonemiddleware.auth_token [None req-5e900456-5555-4071-89a5-bc1595119603 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 16:54:05.561980 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: WARNING keystonemiddleware.auth_token [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 16:54:05.878350 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: WARNING keystonemiddleware.auth_token [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 16:54:05.884291 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: WARNING keystonemiddleware.auth_token [None req-398d3f55-13bb-4f30-8d46-470d9c320923 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 16:54:05.891044 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5557a6bdc9c0 pid: 120608 (default app) Aug 10 16:54:05.905605 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: WARNING keystonemiddleware.auth_token [None req-5e900456-5555-4071-89a5-bc1595119603 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 16:54:05.911535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: WARNING keystonemiddleware.auth_token [None req-5e900456-5555-4071-89a5-bc1595119603 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 16:54:05.917804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5557a6bdc9c0 pid: 120614 (default app) Aug 10 16:54:42.793658 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:42.794509 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:42.796244 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:42.800656 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:42.988400 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:42.991666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:42.995824 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:42.997712 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:44.177878 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4dad070b-66f6-4bae-b6d0-e0bb0a3a612b tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Action: 'create', calling method: .version_select at 0x7f5b0a2f1dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-611201216", "metadata": {"Type": "work"}}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4dad070b-66f6-4bae-b6d0-e0bb0a3a612b tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Request method failure captured: Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 121 Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LSsZaqe0W387pjI7NaT8Or0pqsqXoAwZRTtHf3DJ3QIVfyS9cC8TVhDp-PTylJaEzOJumybqPndVPAB_DGImmtRoEuWjQZy0wcvkifEi-plzSHhIw7LK06Dggjxq2hHwxFlyEI1LLpMdGblovBaVymMly6fum62GbDMnV1bmwalvs Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:54:44.186933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_333933f84263401dbcfee37d9078aba0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 0f4970620f8b4a9aa7eee97a89ef56b7 Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-611201216", "metadata": {"Type": "work"}}} Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: Aug 10 16:54:44.188606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-611201216', 'metadata': {'Type': 'work'}}}} Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise error Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:54:44.189555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 16:54:44.191393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 16:54:44.192785 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 16:54:44.192785 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.192785 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4dad070b-66f6-4bae-b6d0-e0bb0a3a612b tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:54:44.194076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4dad070b-66f6-4bae-b6d0-e0bb0a3a612b tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.407000 Aug 10 16:54:44.199826 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Aug 10 16:54:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1414 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 16:54:44.206338 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-965830bc-a94f-4578-ad81-3b9c8695f7a1 tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Action: 'create', calling method: .version_select at 0x7f5b0a1ff8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2129067167", "metadata": {"Type": "work"}}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-965830bc-a94f-4578-ad81-3b9c8695f7a1 tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Request method failure captured: Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 120 Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LSsZaqe0W387pjI7NaT8Or0pqsqXoAwZRTtHf3DJ3QIVfyS9cC8TVhDp-PTylJaEzOJumybqPndVPAB_DGImmtRoEuWjQZy0wcvkifEi-plzSHhIw7LK06Dggjxq2hHwxFlyEI1LLpMdGblovBaVymMly6fum62GbDMnV1bmwalvs Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:54:44.211818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_333933f84263401dbcfee37d9078aba0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 0f4970620f8b4a9aa7eee97a89ef56b7 Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2129067167", "metadata": {"Type": "work"}}} Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: Aug 10 16:54:44.213162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2129067167', 'metadata': {'Type': 'work'}}}} Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise error Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi '0' Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:54:44.213925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 16:54:44.215266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 16:54:44.219310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 16:54:44.219310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.220818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-965830bc-a94f-4578-ad81-3b9c8695f7a1 tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:54:44.234616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-965830bc-a94f-4578-ad81-3b9c8695f7a1 tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.031466 Aug 10 16:54:44.235317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 2/2] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Aug 10 16:54:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 16:54:44.253210 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8018ff56-3a3b-42af-99ff-f04594a166d4 tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Action: 'create', calling method: .version_select at 0x7f5b0a1af940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-3599940", "metadata": {"Type": "work"}}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8018ff56-3a3b-42af-99ff-f04594a166d4 tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Request method failure captured: Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 116 Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LSsZaqe0W387pjI7NaT8Or0pqsqXoAwZRTtHf3DJ3QIVfyS9cC8TVhDp-PTylJaEzOJumybqPndVPAB_DGImmtRoEuWjQZy0wcvkifEi-plzSHhIw7LK06Dggjxq2hHwxFlyEI1LLpMdGblovBaVymMly6fum62GbDMnV1bmwalvs Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:54:44.265999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_333933f84263401dbcfee37d9078aba0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 0f4970620f8b4a9aa7eee97a89ef56b7 Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-3599940", "metadata": {"Type": "work"}}} Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: Aug 10 16:54:44.267516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-3599940', 'metadata': {'Type': 'work'}}}} Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise error Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi '' Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:54:44.268433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 16:54:44.269973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 16:54:44.271457 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 16:54:44.271457 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.274373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8018ff56-3a3b-42af-99ff-f04594a166d4 tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:54:44.275374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8018ff56-3a3b-42af-99ff-f04594a166d4 tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032081 Aug 10 16:54:44.284136 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 3/3] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Aug 10 16:54:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 16:54:44.298586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5f99011f-65de-4660-8aee-96036b59dd9a tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Calling method '.version_select at 0x7f5b0a1af670>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:44.336097 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c7eb174e-ad64-4ed1-9017-2c24f44c2675 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Action: 'create', calling method: .version_select at 0x7f5b0a2f4dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-20996320"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:54:44.850006 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-5f99011f-65de-4660-8aee-96036b59dd9a tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] HTTP exception thrown: Volume tempest-invalid-1533701031 could not be found. Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5f99011f-65de-4660-8aee-96036b59dd9a tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Request method failure captured: Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1533701031 HTTP/1.1 Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LSsZaqe0W387pjI7NaT8Or0pqsqXoAwZRTtHf3DJ3QIVfyS9cC8TVhDp-PTylJaEzOJumybqPndVPAB_DGImmtRoEuWjQZy0wcvkifEi-plzSHhIw7LK06Dggjxq2hHwxFlyEI1LLpMdGblovBaVymMly6fum62GbDMnV1bmwalvs Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:54:44.854602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_333933f84263401dbcfee37d9078aba0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 0f4970620f8b4a9aa7eee97a89ef56b7 Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Volume tempest-invalid-1533701031 could not be found. Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'tempest-invalid-1533701031'} Aug 10 16:54:44.856498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1533701031 could not be found. (HTTP 404) (Request-ID: req-8e7db0f9-e931-4b8d-a207-c3238a9dbe16) Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:44.857404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 16:54:44.858644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1533701031 could not be found. Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:54:44.859847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1533701031 could not be found. Aug 10 16:54:44.861819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.861819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:44.861819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.861819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:44.861819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:44.861819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:44.861819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:54:44.861819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:54:44.861819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1533701031 could not be found. Aug 10 16:54:44.861819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:44.863953 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5f99011f-65de-4660-8aee-96036b59dd9a tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Returning 404 to user: Volume tempest-invalid-1533701031 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:54:44.865513 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5f99011f-65de-4660-8aee-96036b59dd9a tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1533701031" status: 404 len: 99 microversion: 2.1 time: 0.578107 Aug 10 16:54:44.866546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 4/4] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Aug 10 16:54:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1533701031 => generated 99 bytes in 582 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 16:54:44.885582 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-902009e2-3b93-41ab-9ba2-9ed1ff5187ab tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010033 Aug 10 16:54:44.891847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 5/5] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Aug 10 16:54:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 16:54:44.898856 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2402df51-f767-4d55-a4af-dbb72dc41811 tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004940 Aug 10 16:54:44.904297 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 6/6] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Aug 10 16:54:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 16:54:44.910475 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eee32765-05f6-4396-8048-58b5071d978a tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Calling method '.version_select at 0x7f5b0a0fdc10>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:45.102002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-eee32765-05f6-4396-8048-58b5071d978a tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] HTTP exception thrown: Volume 88b735a3-ef81-47d7-8788-979121c9c10e could not be found. Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eee32765-05f6-4396-8048-58b5071d978a tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Request method failure captured: Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: DELETE /compute/v2.1/os-volumes/88b735a3-ef81-47d7-8788-979121c9c10e HTTP/1.1 Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LSsZaqe0W387pjI7NaT8Or0pqsqXoAwZRTtHf3DJ3QIVfyS9cC8TVhDp-PTylJaEzOJumybqPndVPAB_DGImmtRoEuWjQZy0wcvkifEi-plzSHhIw7LK06Dggjxq2hHwxFlyEI1LLpMdGblovBaVymMly6fum62GbDMnV1bmwalvs Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:54:45.104532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_333933f84263401dbcfee37d9078aba0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 0f4970620f8b4a9aa7eee97a89ef56b7 Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Volume 88b735a3-ef81-47d7-8788-979121c9c10e could not be found. Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '88b735a3-ef81-47d7-8788-979121c9c10e'} Aug 10 16:54:45.106123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88b735a3-ef81-47d7-8788-979121c9c10e could not be found. (HTTP 404) (Request-ID: req-fc2acc8a-670f-4ae7-b6c7-cd0e83bb03d5) Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:45.107041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 16:54:45.108422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88b735a3-ef81-47d7-8788-979121c9c10e could not be found. Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 16:54:45.109694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:54:45.111100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88b735a3-ef81-47d7-8788-979121c9c10e could not be found. Aug 10 16:54:45.111100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.111100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:45.111100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.111100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:45.111100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:45.111100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:45.111100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:54:45.111100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:54:45.111100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88b735a3-ef81-47d7-8788-979121c9c10e could not be found. Aug 10 16:54:45.111100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.113134 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eee32765-05f6-4396-8048-58b5071d978a tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Returning 404 to user: Volume 88b735a3-ef81-47d7-8788-979121c9c10e could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:54:45.114491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-eee32765-05f6-4396-8048-58b5071d978a tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/88b735a3-ef81-47d7-8788-979121c9c10e" status: 404 len: 109 microversion: 2.1 time: 0.208301 Aug 10 16:54:45.115390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 7/7] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 10 16:54:44 2022] DELETE /compute/v2.1/os-volumes/88b735a3-ef81-47d7-8788-979121c9c10e => generated 109 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:54:45.130798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-563d71e8-63cb-4cc2-8d2d-77115d79b75c tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Calling method '.version_select at 0x7f5b0a0fd4c0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:45.246331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-563d71e8-63cb-4cc2-8d2d-77115d79b75c tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] HTTP exception thrown: Volume bfd3a7f1-0b70-4d69-a4fd-b2ee08aa28b4 could not be found. Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-563d71e8-63cb-4cc2-8d2d-77115d79b75c tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Request method failure captured: Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/os-volumes/bfd3a7f1-0b70-4d69-a4fd-b2ee08aa28b4 HTTP/1.1 Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LSsZaqe0W387pjI7NaT8Or0pqsqXoAwZRTtHf3DJ3QIVfyS9cC8TVhDp-PTylJaEzOJumybqPndVPAB_DGImmtRoEuWjQZy0wcvkifEi-plzSHhIw7LK06Dggjxq2hHwxFlyEI1LLpMdGblovBaVymMly6fum62GbDMnV1bmwalvs Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:54:45.333744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_333933f84263401dbcfee37d9078aba0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/333933f84263401dbcfee37d9078aba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 333933f84263401dbcfee37d9078aba0 Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesNegativeTest-1977336214 Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 0f4970620f8b4a9aa7eee97a89ef56b7 Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesNegativeTest-1977336214-project Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Volume bfd3a7f1-0b70-4d69-a4fd-b2ee08aa28b4 could not be found. Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'bfd3a7f1-0b70-4d69-a4fd-b2ee08aa28b4'} Aug 10 16:54:45.347704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bfd3a7f1-0b70-4d69-a4fd-b2ee08aa28b4 could not be found. (HTTP 404) (Request-ID: req-4b7dfd55-cd96-42b1-9f61-6c002d204dc4) Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:45.350427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 16:54:45.355419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bfd3a7f1-0b70-4d69-a4fd-b2ee08aa28b4 could not be found. Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 16:54:45.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bfd3a7f1-0b70-4d69-a4fd-b2ee08aa28b4 could not be found. Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bfd3a7f1-0b70-4d69-a4fd-b2ee08aa28b4 could not be found. Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-563d71e8-63cb-4cc2-8d2d-77115d79b75c tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] Returning 404 to user: Volume bfd3a7f1-0b70-4d69-a4fd-b2ee08aa28b4 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-563d71e8-63cb-4cc2-8d2d-77115d79b75c tempest-VolumesNegativeTest-1977336214 tempest-VolumesNegativeTest-1977336214-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bfd3a7f1-0b70-4d69-a4fd-b2ee08aa28b4" status: 404 len: 109 microversion: 2.1 time: 0.144834 Aug 10 16:54:45.363886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 8/8] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 16:54:45 2022] GET /compute/v2.1/os-volumes/bfd3a7f1-0b70-4d69-a4fd-b2ee08aa28b4 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:54:46.363930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c7eb174e-ad64-4ed1-9017-2c24f44c2675 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.388802 Aug 10 16:54:46.364622 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1/9] 10.222.0.25 () {60 vars in 1155 bytes} [Wed Aug 10 16:54:42 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3391 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 16:54:46.407431 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b5c02f0f-84a0-4a2e-a3bd-72af52fda17e tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a0fd9d0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:46.547387 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b5c02f0f-84a0-4a2e-a3bd-72af52fda17e tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7" status: 200 len: 343 microversion: 2.1 time: 0.172017 Aug 10 16:54:46.554076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 9/10] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 16:54:46 2022] GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7 => generated 343 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:47.564180 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0252e94d-c578-4b14-b858-b1beedeb4a0f tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a16fc10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:47.657436 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0252e94d-c578-4b14-b858-b1beedeb4a0f tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7" status: 200 len: 343 microversion: 2.1 time: 0.098782 Aug 10 16:54:47.658228 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2/11] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 16:54:47 2022] GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7 => generated 343 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:48.676132 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ade0678f-4374-4557-9ba4-228673e0fc43 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a0fd310>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:48.803583 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ade0678f-4374-4557-9ba4-228673e0fc43 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7" status: 200 len: 344 microversion: 2.1 time: 0.135983 Aug 10 16:54:48.804747 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 10/12] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 16:54:48 2022] GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:48.822518 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4c5e45ec-9c98-4485-8a17-1104de959c0c tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Action: 'create', calling method: .version_select at 0x7f5b0a186280>, body: {"snapshot": {"volume_id": "f7c9077a-ac60-4756-845b-48d032ce15e7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-259815154"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:54:49.433312 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4c5e45ec-9c98-4485-8a17-1104de959c0c tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.619828 Aug 10 16:54:49.436107 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3/13] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Aug 10 16:54:48 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:49.448677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-06c40a01-e5f3-469a-a357-70ef1b5901d3 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a1103a0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:49.658997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-06c40a01-e5f3-469a-a357-70ef1b5901d3 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607" status: 200 len: 286 microversion: 2.1 time: 0.214699 Aug 10 16:54:49.659990 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 11/14] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 10 16:54:49 2022] GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 => generated 286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:49.673084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5639f67d-b375-487e-9dea-8aa527306866 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a184430>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:49.781939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5639f67d-b375-487e-9dea-8aa527306866 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.114226 Aug 10 16:54:49.782937 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 4/15] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Aug 10 16:54:49 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:49.799634 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ff5735c5-35b7-4122-a91f-6c6de57e5ff1 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a1101f0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:49.863704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ff5735c5-35b7-4122-a91f-6c6de57e5ff1 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607" status: 200 len: 286 microversion: 2.1 time: 0.072833 Aug 10 16:54:49.865030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 12/16] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 10 16:54:49 2022] GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:50.878189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9ee46f96-d4b3-488e-9335-f37a28a0836f tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a1861f0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:50.967208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9ee46f96-d4b3-488e-9335-f37a28a0836f tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607" status: 200 len: 286 microversion: 2.1 time: 0.094009 Aug 10 16:54:50.968336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 5/17] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 10 16:54:50 2022] GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:51.984871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2d72deda-ca1b-43ff-86ee-1c0c49f44228 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a0fd310>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:52.040207 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2d72deda-ca1b-43ff-86ee-1c0c49f44228 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607" status: 200 len: 286 microversion: 2.1 time: 0.064042 Aug 10 16:54:52.045759 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 13/18] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 10 16:54:51 2022] GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:53.055243 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-151a21ae-7d3f-4546-b149-1fb12230ef5c tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a16fb80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:53.126162 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-151a21ae-7d3f-4546-b149-1fb12230ef5c tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607" status: 200 len: 286 microversion: 2.1 time: 0.076633 Aug 10 16:54:53.126868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 6/19] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 10 16:54:53 2022] GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:54.142632 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e93b159a-0400-49f4-9bb7-a5f03e598350 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a184280>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:54.452319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-331093278", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "networks": [{"uuid": "8b7ae3a7-9f33-43f8-8150-2b9e4a8970b7"}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:54:54.582424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e93b159a-0400-49f4-9bb7-a5f03e598350 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607" status: 200 len: 286 microversion: 2.1 time: 0.446975 Aug 10 16:54:54.587951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 7/20] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 10 16:54:54 2022] GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 => generated 286 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:54.667770 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] validate_networks() for [('8b7ae3a7-9f33-43f8-8150-2b9e4a8970b7', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:54:55.595303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9cf1b469-9c54-4a88-a358-6941af335b91 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a16fe50>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:55.745898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9cf1b469-9c54-4a88-a358-6941af335b91 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607" status: 200 len: 286 microversion: 2.1 time: 0.154241 Aug 10 16:54:55.747268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 8/21] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 10 16:54:55 2022] GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:56.812986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-13212dda-5775-48f7-9deb-b0eedc590a38 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: .version_select at 0x7f5b0a1861f0>, body: {"keypair": {"name": "tempest-keypair-1256132166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjj3qtMCa7kJgfJXCjZaN54kYof9cIWipcNOSXDuEDY/BWiupOkHZafm1PGfzO1hdUB/+5cgHLR4+AiIPLKf5Dn1wa4x6Nl5IPxlA7w2yp+YMmf3Nc5hNm8OgRUCG3Sfg=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:54:56.927581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-13212dda-5775-48f7-9deb-b0eedc590a38 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:54:56.948188 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-13212dda-5775-48f7-9deb-b0eedc590a38 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for user 7a701149974b45db9f782bc5a232aabe and project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:54:57.085972 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-13212dda-5775-48f7-9deb-b0eedc590a38 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.604234 Aug 10 16:54:57.093938 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 9/22] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 10 16:54:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:57.099044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0932c4a7-87ff-4dc3-bbe5-641b1cb359d5 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a15eaf0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:57.155960 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0932c4a7-87ff-4dc3-bbe5-641b1cb359d5 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607" status: 200 len: 287 microversion: 2.1 time: 0.060853 Aug 10 16:54:57.156907 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 10/23] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 10 16:54:57 2022] GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:54:57.168434 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b00c5d1e-f52f-43bc-a125-2cdb6592d8bd tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a10d790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:57.286318 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b00c5d1e-f52f-43bc-a125-2cdb6592d8bd tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607" status: 202 len: 0 microversion: 2.1 time: 0.121547 Aug 10 16:54:57.287303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 11/24] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Aug 10 16:54:57 2022] DELETE /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 16:54:57.295979 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b9f95b2a-8444-4712-9bc1-4b437afc8fe3 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b0a10de50>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:57.362141 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b9f95b2a-8444-4712-9bc1-4b437afc8fe3 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607" status: 200 len: 286 microversion: 2.1 time: 0.070773 Aug 10 16:54:57.362909 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 10 16:54:57 2022] GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:54:58.452304 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1460067847", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:54:58.736452 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] validate_networks() for [('58fa7b48-111c-4ce4-8372-d8a52b5c42d3', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:54:58.934966 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:54:58.936519 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:54:58.937258 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:54:58.937898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:54:58.938615 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:54:58.972655 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:54:58.973493 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:54:58.976245 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:54:58.979620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:54:58.980460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:54:58.981172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:54:59.108299 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Getting quotas for project 25eeef036a7e44b0b5ee4d989f7ec507. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:54:59.151780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Getting quotas for user 6677b89e26a94e5da074431e11e12050 and project 25eeef036a7e44b0b5ee4d989f7ec507. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:54:59.203484 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:54:59.210901 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:54:59.383871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8eab3653-ae1b-41c1-930a-5b4d52a2914b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.256668 Aug 10 16:54:59.384549 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 14/26] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 5258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 16:54:59.406118 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-39706547-7cec-420b-8d5d-47e6c00dbe68 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b09804dc0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:59.461315 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-39706547-7cec-420b-8d5d-47e6c00dbe68 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] HTTP exception thrown: Snapshot d91891b8-a263-4c49-ad3d-b4c38d85b607 could not be found. Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-39706547-7cec-420b-8d5d-47e6c00dbe68 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Request method failure captured: Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 HTTP/1.1 Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LSvT5SQOJ3MlYLY3sPf2kTLQDdVEs77ZNFua_7zdU0r1vzXnc8J_PeKvh1f67SD09DtqcOEiQPK25UTDxypLlZrt1dVS_kmpOifBixhA7DlV-7SszI1ZSFEotRlMDpbLgAeEeJBW7RLjiiAnf1yLVQGhMQPXLKFWis1_LEbMrRn6k Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 6840c8d2676542ecbed0e9a237e489f5 Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:54:59.463669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6840c8d2676542ecbed0e9a237e489f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 6840c8d2676542ecbed0e9a237e489f5 Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesSnapshotsTestJSON-121099797-project Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 9ea7096e5ac84095a0d6ff2b048afd91 Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesSnapshotsTestJSON-121099797-project Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Snapshot d91891b8-a263-4c49-ad3d-b4c38d85b607 could not be found. Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'd91891b8-a263-4c49-ad3d-b4c38d85b607'} Aug 10 16:54:59.465586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d91891b8-a263-4c49-ad3d-b4c38d85b607 could not be found. (HTTP 404) (Request-ID: req-3b392b1d-452a-4994-966f-a3c79cad79cf) Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:59.469831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 16:54:59.470898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d91891b8-a263-4c49-ad3d-b4c38d85b607 could not be found. Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 16:54:59.472107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d91891b8-a263-4c49-ad3d-b4c38d85b607 could not be found. Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d91891b8-a263-4c49-ad3d-b4c38d85b607 could not be found. Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-39706547-7cec-420b-8d5d-47e6c00dbe68 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Returning 404 to user: Snapshot d91891b8-a263-4c49-ad3d-b4c38d85b607 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-39706547-7cec-420b-8d5d-47e6c00dbe68 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607" status: 404 len: 111 microversion: 2.1 time: 0.079474 Aug 10 16:54:59.473278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 15/27] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Aug 10 16:54:59 2022] GET /compute/v2.1/os-snapshots/d91891b8-a263-4c49-ad3d-b4c38d85b607 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:54:59.483654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c8059447-76c2-4ab4-b089-8c05389cfe05 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:59.483654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c8059447-76c2-4ab4-b089-8c05389cfe05 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:54:59.744017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c8059447-76c2-4ab4-b089-8c05389cfe05 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:54:59.759403 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c8059447-76c2-4ab4-b089-8c05389cfe05 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1214 microversion: 2.1 time: 0.292113 Aug 10 16:54:59.761515 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 16/28] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:54:59 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1214 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:54:59.787975 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3517631e-fa17-4f7f-a08f-4acc579c6883 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b08fb55e0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:54:59.944974 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3517631e-fa17-4f7f-a08f-4acc579c6883 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7" status: 202 len: 0 microversion: 2.1 time: 0.181588 Aug 10 16:54:59.945556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 17/29] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 10 16:54:59 2022] DELETE /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 16:54:59.961501 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-85252f73-2dff-4a43-97b1-de69e8d48f1b tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b08fbe670>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:00.131215 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-85252f73-2dff-4a43-97b1-de69e8d48f1b tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7" status: 200 len: 343 microversion: 2.1 time: 0.180829 Aug 10 16:55:00.131925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 18/30] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 16:54:59 2022] GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7 => generated 343 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:55:00.783916 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3575ec9f-9aa9-46e6-a760-1304268d3780 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:00.786116 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3575ec9f-9aa9-46e6-a760-1304268d3780 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:00.998810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3575ec9f-9aa9-46e6-a760-1304268d3780 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:01.016070 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3575ec9f-9aa9-46e6-a760-1304268d3780 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1214 microversion: 2.1 time: 0.236466 Aug 10 16:55:01.018400 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 19/31] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:00 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1214 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:01.148469 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3d8508dd-d80c-4859-b2b9-105aaca9d85f tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b08fbe790>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:01.227850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-3d8508dd-d80c-4859-b2b9-105aaca9d85f tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] HTTP exception thrown: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3d8508dd-d80c-4859-b2b9-105aaca9d85f tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Request method failure captured: Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7 HTTP/1.1 Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LSvT5SQOJ3MlYLY3sPf2kTLQDdVEs77ZNFua_7zdU0r1vzXnc8J_PeKvh1f67SD09DtqcOEiQPK25UTDxypLlZrt1dVS_kmpOifBixhA7DlV-7SszI1ZSFEotRlMDpbLgAeEeJBW7RLjiiAnf1yLVQGhMQPXLKFWis1_LEbMrRn6k Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 6840c8d2676542ecbed0e9a237e489f5 Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:55:01.230145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6840c8d2676542ecbed0e9a237e489f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 6840c8d2676542ecbed0e9a237e489f5 Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesSnapshotsTestJSON-121099797-project Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 9ea7096e5ac84095a0d6ff2b048afd91 Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesSnapshotsTestJSON-121099797-project Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'f7c9077a-ac60-4756-845b-48d032ce15e7'} Aug 10 16:55:01.232037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. (HTTP 404) (Request-ID: req-86045eb2-9584-4413-8e69-d0b0527de8dd) Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:55:01.232858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 16:55:01.234012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 16:55:01.235150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:55:01.236284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:01.236284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:01.236284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:55:01.236284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:01.236284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:01.236284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:55:01.236284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:55:01.236284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:55:01.236284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:55:01.236284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:01.236284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:01.240170 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3d8508dd-d80c-4859-b2b9-105aaca9d85f tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Returning 404 to user: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:55:01.240170 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3d8508dd-d80c-4859-b2b9-105aaca9d85f tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7" status: 404 len: 109 microversion: 2.1 time: 0.094351 Aug 10 16:55:01.240170 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 20/32] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 16:55:01 2022] GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 16:55:01.999074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-84053225-2ee8-460f-bf5a-3c04c6b5588a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Action: 'create', calling method: .version_select at 0x7f5b08fd21f0>, body: {"keypair": {"name": "tempest-keypair-1825176426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4x8PeSUwYvJcrjIGTFbC/dbFxsLg7KL3r6oXVUPqpeT7exYgl7u1LzMXDwj0ogsmgXo5LKNHL6u40Tcmrf/b/MFoExv5XW8B3bXFAbaNvyR4TSKueeJyuSqH9jRkycnQ=="}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:02.057631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-84053225-2ee8-460f-bf5a-3c04c6b5588a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Getting quotas for project d17c2f74324146ca932ff151c9f7a003. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:55:02.066948 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-84053225-2ee8-460f-bf5a-3c04c6b5588a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Getting quotas for user 96495ad2ad764ba3a0fb1e3bc28fd8bd and project d17c2f74324146ca932ff151c9f7a003. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:55:02.155506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-84053225-2ee8-460f-bf5a-3c04c6b5588a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.915408 Aug 10 16:55:02.156497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 21/33] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Aug 10 16:55:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 917 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 16:55:02.167678 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4dd35e89-a22d-432d-a6f3-3ccef2b4dbe1 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b087663a0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:02.274560 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-4dd35e89-a22d-432d-a6f3-3ccef2b4dbe1 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] HTTP exception thrown: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4dd35e89-a22d-432d-a6f3-3ccef2b4dbe1 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Request method failure captured: Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: DELETE /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7 HTTP/1.1 Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LSvT5SQOJ3MlYLY3sPf2kTLQDdVEs77ZNFua_7zdU0r1vzXnc8J_PeKvh1f67SD09DtqcOEiQPK25UTDxypLlZrt1dVS_kmpOifBixhA7DlV-7SszI1ZSFEotRlMDpbLgAeEeJBW7RLjiiAnf1yLVQGhMQPXLKFWis1_LEbMrRn6k Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 6840c8d2676542ecbed0e9a237e489f5 Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:55:02.283471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6840c8d2676542ecbed0e9a237e489f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 6840c8d2676542ecbed0e9a237e489f5 Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesSnapshotsTestJSON-121099797-project Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 9ea7096e5ac84095a0d6ff2b048afd91 Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesSnapshotsTestJSON-121099797-project Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'f7c9077a-ac60-4756-845b-48d032ce15e7'} Aug 10 16:55:02.284701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. (HTTP 404) (Request-ID: req-2ae6d8c5-8560-4823-8a74-3d3371bce01f) Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:55:02.285420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 16:55:02.286594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 16:55:02.287631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4dd35e89-a22d-432d-a6f3-3ccef2b4dbe1 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Returning 404 to user: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4dd35e89-a22d-432d-a6f3-3ccef2b4dbe1 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7" status: 404 len: 109 microversion: 2.1 time: 0.128902 Aug 10 16:55:02.290056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 22/34] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 10 16:55:02 2022] DELETE /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:55:02.304634 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-336882b9-f089-4893-81a5-c96d702acb39 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:02.308388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-336882b9-f089-4893-81a5-c96d702acb39 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:02.327500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-336882b9-f089-4893-81a5-c96d702acb39 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:02.328016 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-336882b9-f089-4893-81a5-c96d702acb39 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:02.328552 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-336882b9-f089-4893-81a5-c96d702acb39 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:02.333771 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-336882b9-f089-4893-81a5-c96d702acb39 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:02.334234 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-336882b9-f089-4893-81a5-c96d702acb39 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:02.334717 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-336882b9-f089-4893-81a5-c96d702acb39 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:02.739290 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-336882b9-f089-4893-81a5-c96d702acb39 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:02.761373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-336882b9-f089-4893-81a5-c96d702acb39 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1218 microversion: 2.1 time: 0.473289 Aug 10 16:55:02.763712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 23/35] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:02 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1218 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:02.774922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-375753de-d8ac-4d17-a9a1-b670b0299170 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Calling method '.version_select at 0x7f5b08766c10>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:02.843140 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-375753de-d8ac-4d17-a9a1-b670b0299170 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] HTTP exception thrown: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-375753de-d8ac-4d17-a9a1-b670b0299170 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Request method failure captured: Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7 HTTP/1.1 Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LSvT5SQOJ3MlYLY3sPf2kTLQDdVEs77ZNFua_7zdU0r1vzXnc8J_PeKvh1f67SD09DtqcOEiQPK25UTDxypLlZrt1dVS_kmpOifBixhA7DlV-7SszI1ZSFEotRlMDpbLgAeEeJBW7RLjiiAnf1yLVQGhMQPXLKFWis1_LEbMrRn6k Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 6840c8d2676542ecbed0e9a237e489f5 Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:55:02.846231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6840c8d2676542ecbed0e9a237e489f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6840c8d2676542ecbed0e9a237e489f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 6840c8d2676542ecbed0e9a237e489f5 Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-121099797 Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesSnapshotsTestJSON-121099797-project Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 9ea7096e5ac84095a0d6ff2b048afd91 Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesSnapshotsTestJSON-121099797-project Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'f7c9077a-ac60-4756-845b-48d032ce15e7'} Aug 10 16:55:02.847494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. (HTTP 404) (Request-ID: req-4e87f806-b842-4265-9eab-7fc36bb1d888) Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:55:02.848339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 16:55:02.849672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 16:55:02.851465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:55:02.852598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-375753de-d8ac-4d17-a9a1-b670b0299170 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] Returning 404 to user: Volume f7c9077a-ac60-4756-845b-48d032ce15e7 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:55:02.853984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-375753de-d8ac-4d17-a9a1-b670b0299170 tempest-VolumesSnapshotsTestJSON-121099797 tempest-VolumesSnapshotsTestJSON-121099797-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7" status: 404 len: 109 microversion: 2.1 time: 0.083292 Aug 10 16:55:02.855612 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 24/36] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 16:55:02 2022] GET /compute/v2.1/os-volumes/f7c9077a-ac60-4756-845b-48d032ce15e7 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:55:03.797828 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-767100e9-2380-42a4-a044-382a05530e90 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:03.797828 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-767100e9-2380-42a4-a044-382a05530e90 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:03.820018 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-767100e9-2380-42a4-a044-382a05530e90 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:03.820614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-767100e9-2380-42a4-a044-382a05530e90 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:03.821313 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-767100e9-2380-42a4-a044-382a05530e90 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:03.822156 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-767100e9-2380-42a4-a044-382a05530e90 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:03.823794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-767100e9-2380-42a4-a044-382a05530e90 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:03.825542 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-767100e9-2380-42a4-a044-382a05530e90 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:04.105193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-767100e9-2380-42a4-a044-382a05530e90 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:04.120351 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-767100e9-2380-42a4-a044-382a05530e90 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1274 microversion: 2.1 time: 0.337045 Aug 10 16:55:04.130922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 25/37] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:03 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1274 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:04.140883 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:55:04.141359 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:55:04.141829 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:55:04.142249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:55:04.142708 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:55:04.165015 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:04.165699 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:04.166817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:04.168779 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:04.169407 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:04.170367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:04.204450 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Getting quotas for project 36cf7bbfa5d3420996a2af036cf8e0da. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:55:04.210336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Getting quotas for user c7fac765624c4e0b85b01f356a14a1cb and project 36cf7bbfa5d3420996a2af036cf8e0da. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:55:04.224759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:55:04.228232 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:55:04.402936 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d635230c-12df-4a0e-a418-1a66250841e0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.306303 Aug 10 16:55:04.420052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b8e6dca3-6f31-444a-b5b4-9fe524e94436 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:04.420746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 13/38] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:54:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 6325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 16:55:04.421540 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b8e6dca3-6f31-444a-b5b4-9fe524e94436 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:04.543639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b8e6dca3-6f31-444a-b5b4-9fe524e94436 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:04.566240 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b8e6dca3-6f31-444a-b5b4-9fe524e94436 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1222 microversion: 2.1 time: 0.150378 Aug 10 16:55:04.574083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 26/39] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:04 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:05.155735 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f6e2fee3-d774-4ec0-9ae0-cd99810ad590 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:05.156423 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f6e2fee3-d774-4ec0-9ae0-cd99810ad590 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:05.162204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-97171107", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbfebec6-8639-47f9-80f8-59f6b2be1e54"}], "security_groups": [{"name": "tempest-securitygroup--479838787"}], "key_name": "tempest-keypair-1256132166", "user_data": "}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:05.226526 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6e2fee3-d774-4ec0-9ae0-cd99810ad590 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:05.227119 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6e2fee3-d774-4ec0-9ae0-cd99810ad590 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:05.231727 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6e2fee3-d774-4ec0-9ae0-cd99810ad590 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:05.232599 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6e2fee3-d774-4ec0-9ae0-cd99810ad590 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:05.233333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6e2fee3-d774-4ec0-9ae0-cd99810ad590 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:05.234117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6e2fee3-d774-4ec0-9ae0-cd99810ad590 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:05.696168 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] validate_networks() for [('dbfebec6-8639-47f9-80f8-59f6b2be1e54', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:55:05.738934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f6e2fee3-d774-4ec0-9ae0-cd99810ad590 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:05.797531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f6e2fee3-d774-4ec0-9ae0-cd99810ad590 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1272 microversion: 2.1 time: 0.656429 Aug 10 16:55:05.802471 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 14/40] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:05 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1272 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:05.825869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1259718510", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:05.977363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] validate_networks() for [('58fa7b48-111c-4ce4-8372-d8a52b5c42d3', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:55:08.764563 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:55:08.765287 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:55:08.765850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:55:08.766338 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:55:08.766829 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:55:08.807922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:08.808855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:08.810606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:08.815127 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:08.816076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:08.818441 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:08.885537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:55:08.895802 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for user 7a701149974b45db9f782bc5a232aabe and project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:55:08.929919 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:55:08.943263 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:55:09.106502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cb42c282-4638-4520-a3d1-80c14ec5e783 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.954918 Aug 10 16:55:09.107155 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 27/41] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:55:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 3956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 16:55:09.127854 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0f34457e-7fb0-4133-abdc-db548560db8e tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:09.137260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0f34457e-7fb0-4133-abdc-db548560db8e tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:09.158092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f34457e-7fb0-4133-abdc-db548560db8e tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:09.158594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f34457e-7fb0-4133-abdc-db548560db8e tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:09.159061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f34457e-7fb0-4133-abdc-db548560db8e tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:09.162490 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f34457e-7fb0-4133-abdc-db548560db8e tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:09.162979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f34457e-7fb0-4133-abdc-db548560db8e tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:09.163419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f34457e-7fb0-4133-abdc-db548560db8e tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:10.121648 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:55:10.122244 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:55:10.122682 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:55:10.123438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:55:10.124008 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:55:10.152362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:10.153995 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:10.158431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:10.159868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:10.163201 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:10.166440 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:10.274816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Getting quotas for project 36cf7bbfa5d3420996a2af036cf8e0da. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:55:10.295487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Getting quotas for user c7fac765624c4e0b85b01f356a14a1cb and project 36cf7bbfa5d3420996a2af036cf8e0da. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:55:10.374509 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:55:10.385909 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:55:10.591874 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-929903a8-c59f-4ae2-8edd-613b0722ba53 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.785900 Aug 10 16:55:10.594640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 15/42] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:55:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 4791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 16:55:10.610276 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e6fd3c5c-d852-4906-ad9a-98857657a95a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:10.612382 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e6fd3c5c-d852-4906-ad9a-98857657a95a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:10.801688 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e6fd3c5c-d852-4906-ad9a-98857657a95a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:10.902195 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e6fd3c5c-d852-4906-ad9a-98857657a95a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1240 microversion: 2.1 time: 0.305068 Aug 10 16:55:10.927811 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 16/43] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:10 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1240 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:10.974837 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f645b11d-ff4f-49ab-b244-8a9a26b8390b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:10.975532 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f645b11d-ff4f-49ab-b244-8a9a26b8390b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:11.309633 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f645b11d-ff4f-49ab-b244-8a9a26b8390b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:11.332676 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f645b11d-ff4f-49ab-b244-8a9a26b8390b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1222 microversion: 2.1 time: 0.410701 Aug 10 16:55:11.333493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 17/44] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:10 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1222 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:11.612333 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0f34457e-7fb0-4133-abdc-db548560db8e tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:11.625205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0f34457e-7fb0-4133-abdc-db548560db8e tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 2.501190 Aug 10 16:55:11.628625 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 28/45] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:09 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:11.953157 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d9e6598-f51e-47c5-80d0-559a9e4108f8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:11.954425 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d9e6598-f51e-47c5-80d0-559a9e4108f8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:11.966802 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d9e6598-f51e-47c5-80d0-559a9e4108f8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:11.967305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d9e6598-f51e-47c5-80d0-559a9e4108f8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:11.975499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d9e6598-f51e-47c5-80d0-559a9e4108f8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:11.976477 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d9e6598-f51e-47c5-80d0-559a9e4108f8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:11.976970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d9e6598-f51e-47c5-80d0-559a9e4108f8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:11.977566 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d9e6598-f51e-47c5-80d0-559a9e4108f8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:12.365155 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9c7cc5a8-b5a0-4920-958b-2ba3021ddda6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:12.368904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9c7cc5a8-b5a0-4920-958b-2ba3021ddda6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:12.409337 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5a8-b5a0-4920-958b-2ba3021ddda6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:12.415234 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5a8-b5a0-4920-958b-2ba3021ddda6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:12.422526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5a8-b5a0-4920-958b-2ba3021ddda6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:12.425605 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5a8-b5a0-4920-958b-2ba3021ddda6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:12.429131 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5a8-b5a0-4920-958b-2ba3021ddda6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:12.429910 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5a8-b5a0-4920-958b-2ba3021ddda6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:12.960866 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d9e6598-f51e-47c5-80d0-559a9e4108f8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:12.973173 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d9e6598-f51e-47c5-80d0-559a9e4108f8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1292 microversion: 2.1 time: 1.040007 Aug 10 16:55:12.992519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 18/46] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:11 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1292 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:13.003766 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a855b7b1-abec-4770-bdea-373e7777aea7 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:13.005788 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a855b7b1-abec-4770-bdea-373e7777aea7 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:13.018309 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a855b7b1-abec-4770-bdea-373e7777aea7 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:13.024045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a855b7b1-abec-4770-bdea-373e7777aea7 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:13.024909 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a855b7b1-abec-4770-bdea-373e7777aea7 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:13.026340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a855b7b1-abec-4770-bdea-373e7777aea7 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:13.027093 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a855b7b1-abec-4770-bdea-373e7777aea7 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:13.027749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a855b7b1-abec-4770-bdea-373e7777aea7 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:13.084089 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9c7cc5a8-b5a0-4920-958b-2ba3021ddda6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:13.102610 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9c7cc5a8-b5a0-4920-958b-2ba3021ddda6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1226 microversion: 2.1 time: 0.744900 Aug 10 16:55:13.107375 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 29/47] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:12 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1226 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:13.905122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-936122511", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a34b9ffa-6cd7-4dc0-afee-b8aa4e4d33d1"}], "security_groups": [{"name": "tempest-securitygroup--739839323"}], "key_name": "tempest-keypair-1825176426", "user_data": "}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:14.155396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] validate_networks() for [('a34b9ffa-6cd7-4dc0-afee-b8aa4e4d33d1', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:55:14.906515 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a855b7b1-abec-4770-bdea-373e7777aea7 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:14.949489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a855b7b1-abec-4770-bdea-373e7777aea7 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 1.946150 Aug 10 16:55:14.951597 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 19/48] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:12 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:14.976314 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-55b0e2d1-2a0b-4d0d-b092-ddc853d959ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:14.977199 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-55b0e2d1-2a0b-4d0d-b092-ddc853d959ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:14.998380 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55b0e2d1-2a0b-4d0d-b092-ddc853d959ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:15.002073 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55b0e2d1-2a0b-4d0d-b092-ddc853d959ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:15.004661 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55b0e2d1-2a0b-4d0d-b092-ddc853d959ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:15.007005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55b0e2d1-2a0b-4d0d-b092-ddc853d959ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:15.008630 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55b0e2d1-2a0b-4d0d-b092-ddc853d959ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:15.009963 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55b0e2d1-2a0b-4d0d-b092-ddc853d959ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:15.204679 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-55b0e2d1-2a0b-4d0d-b092-ddc853d959ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:15.216005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-55b0e2d1-2a0b-4d0d-b092-ddc853d959ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1298 microversion: 2.1 time: 0.255010 Aug 10 16:55:15.218732 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 20/49] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:14 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1298 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:15.236567 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5e1c80bd-3e0a-46cb-ae13-9d473f32656c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:15.241193 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5e1c80bd-3e0a-46cb-ae13-9d473f32656c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:15.260770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1c80bd-3e0a-46cb-ae13-9d473f32656c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:15.269619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1c80bd-3e0a-46cb-ae13-9d473f32656c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:15.271595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1c80bd-3e0a-46cb-ae13-9d473f32656c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:15.277492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1c80bd-3e0a-46cb-ae13-9d473f32656c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:15.281376 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1c80bd-3e0a-46cb-ae13-9d473f32656c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:15.282334 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1c80bd-3e0a-46cb-ae13-9d473f32656c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:15.582662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:55:15.592754 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:55:15.597335 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:55:15.599081 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:55:15.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:55:15.622716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:15.623220 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:15.625965 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:15.627072 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:15.629608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:15.631635 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:15.696698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Getting quotas for project d17c2f74324146ca932ff151c9f7a003. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:55:15.711395 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Getting quotas for user 96495ad2ad764ba3a0fb1e3bc28fd8bd and project d17c2f74324146ca932ff151c9f7a003. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:55:15.743084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:55:15.748897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:55:15.765804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5e1c80bd-3e0a-46cb-ae13-9d473f32656c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:15.779923 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5e1c80bd-3e0a-46cb-ae13-9d473f32656c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1280 microversion: 2.1 time: 0.554251 Aug 10 16:55:15.782944 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 21/50] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:15 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1280 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:15.924799 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7e11198e-e931-4ae7-9a07-8bda5708d708 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.042557 Aug 10 16:55:15.942614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 30/51] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Aug 10 16:55:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 16:55:15.979357 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-05b8a03e-30b1-4531-b010-497a08f831aa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:16.000503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-05b8a03e-30b1-4531-b010-497a08f831aa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:16.255502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-05b8a03e-30b1-4531-b010-497a08f831aa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:16.268816 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-05b8a03e-30b1-4531-b010-497a08f831aa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:16.272606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-05b8a03e-30b1-4531-b010-497a08f831aa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:16.278790 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-05b8a03e-30b1-4531-b010-497a08f831aa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1281 microversion: 2.20 time: 0.322857 Aug 10 16:55:16.281082 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 31/52] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:15 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1281 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:16.309779 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-62731cf5-1a91-4e47-bb9a-6667382590ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:16.312366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-62731cf5-1a91-4e47-bb9a-6667382590ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:16.323113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62731cf5-1a91-4e47-bb9a-6667382590ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:16.325312 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62731cf5-1a91-4e47-bb9a-6667382590ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:16.326962 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62731cf5-1a91-4e47-bb9a-6667382590ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:16.329242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62731cf5-1a91-4e47-bb9a-6667382590ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:16.329906 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62731cf5-1a91-4e47-bb9a-6667382590ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:16.332558 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62731cf5-1a91-4e47-bb9a-6667382590ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:16.482863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6d9f5aad-07cc-4606-ae4e-4afb76f01780 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Action: 'create', calling method: .version_select at 0x7f5b08731940>, body: {"keypair": {"name": "tempest-keypair-854479938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQcNZKtMMuzOE7eX8cbpt1oTh20tkr3WAhrX8Yf7ZUWdbh986Cj3HjTKEj5c/kQ3aUgwICt/qVzF25KDA98ad3z6Bm4MS65qADB7eHe1kHY5LU61pXtGc4sg086DbBypA=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:16.517786 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-6d9f5aad-07cc-4606-ae4e-4afb76f01780 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Getting quotas for project c11dfd80b6c544f6b87a58d5a25c5649. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:55:16.528422 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-6d9f5aad-07cc-4606-ae4e-4afb76f01780 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Getting quotas for user 77b8847d10744ec98e0ed7a3f1e991ed and project c11dfd80b6c544f6b87a58d5a25c5649. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:55:16.586782 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6d9f5aad-07cc-4606-ae4e-4afb76f01780 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.801250 Aug 10 16:55:16.590252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 22/53] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 10 16:55:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:55:16.647393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-62731cf5-1a91-4e47-bb9a-6667382590ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:16.659816 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-62731cf5-1a91-4e47-bb9a-6667382590ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.377548 Aug 10 16:55:16.660654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 32/54] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:16 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:16.679759 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0e4fee4b-d5d2-4c35-8f44-1de360516083 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:16.680608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0e4fee4b-d5d2-4c35-8f44-1de360516083 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:16.688465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e4fee4b-d5d2-4c35-8f44-1de360516083 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:16.689428 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e4fee4b-d5d2-4c35-8f44-1de360516083 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:16.690091 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e4fee4b-d5d2-4c35-8f44-1de360516083 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:16.691291 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e4fee4b-d5d2-4c35-8f44-1de360516083 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:16.691931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e4fee4b-d5d2-4c35-8f44-1de360516083 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:16.693176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e4fee4b-d5d2-4c35-8f44-1de360516083 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:16.838581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9b523a58-b539-4dae-8797-99e0a3b24d6a req-25b584e7-e60b-4aa9-bb5a-4e961e28930e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e14798-1b43-4a9b-8ff3-70943ce0e43d", "tag": "e5aaffe6-9f88-4d4e-b636-16032e55f1d3"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:16.854117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9b523a58-b539-4dae-8797-99e0a3b24d6a req-25b584e7-e60b-4aa9-bb5a-4e961e28930e service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:16.855522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9b523a58-b539-4dae-8797-99e0a3b24d6a req-25b584e7-e60b-4aa9-bb5a-4e961e28930e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:16.856658 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9b523a58-b539-4dae-8797-99e0a3b24d6a req-25b584e7-e60b-4aa9-bb5a-4e961e28930e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:16.883741 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0e4fee4b-d5d2-4c35-8f44-1de360516083 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:16.884213 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9b523a58-b539-4dae-8797-99e0a3b24d6a req-25b584e7-e60b-4aa9-bb5a-4e961e28930e service nova] Creating event network-changed:e5aaffe6-9f88-4d4e-b636-16032e55f1d3 for instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d on hv-cinder-83602 Aug 10 16:55:16.885067 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9b523a58-b539-4dae-8797-99e0a3b24d6a req-25b584e7-e60b-4aa9-bb5a-4e961e28930e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 16:55:16.885755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9b523a58-b539-4dae-8797-99e0a3b24d6a req-25b584e7-e60b-4aa9-bb5a-4e961e28930e service nova] Acquired lock "compute-rpcapi-router" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 16:55:16.887575 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2bbf75f-8c18-42fc-af94-0d6eaad10742 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:16.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2bbf75f-8c18-42fc-af94-0d6eaad10742 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:16.888868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2bbf75f-8c18-42fc-af94-0d6eaad10742 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:16.891479 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2bbf75f-8c18-42fc-af94-0d6eaad10742 None None] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:16.892414 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2bbf75f-8c18-42fc-af94-0d6eaad10742 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:16.893475 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2bbf75f-8c18-42fc-af94-0d6eaad10742 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:16.905963 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.compute.rpcapi [None req-d2bbf75f-8c18-42fc-af94-0d6eaad10742 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 16:55:16.907493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2bbf75f-8c18-42fc-af94-0d6eaad10742 None None] Releasing lock "compute-rpcapi-router" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 16:55:16.914940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0e4fee4b-d5d2-4c35-8f44-1de360516083 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1298 microversion: 2.1 time: 0.237602 Aug 10 16:55:16.917022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 33/55] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:16 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1298 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:16.934495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-abd2ec59-a720-42d2-9ad1-79e5e8928622 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:16.937959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-abd2ec59-a720-42d2-9ad1-79e5e8928622 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:16.938387 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d2bbf75f-8c18-42fc-af94-0d6eaad10742 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.345915 Aug 10 16:55:16.939353 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 23/56] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:55:16.956502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd2ec59-a720-42d2-9ad1-79e5e8928622 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:16.957009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd2ec59-a720-42d2-9ad1-79e5e8928622 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:16.957704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd2ec59-a720-42d2-9ad1-79e5e8928622 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:16.960549 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd2ec59-a720-42d2-9ad1-79e5e8928622 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:16.961200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd2ec59-a720-42d2-9ad1-79e5e8928622 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:16.964699 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd2ec59-a720-42d2-9ad1-79e5e8928622 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:17.147553 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-abd2ec59-a720-42d2-9ad1-79e5e8928622 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:17.161901 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-abd2ec59-a720-42d2-9ad1-79e5e8928622 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1280 microversion: 2.1 time: 0.239945 Aug 10 16:55:17.163578 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 34/57] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:16 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:17.304633 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:17.305415 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:17.318975 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:17.320867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:17.322195 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:17.324336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:17.325968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:17.328336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:17.465826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:17.477311 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:17.484616 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:17.487023 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9bc8546f-9049-488a-8e08-60a3845baa21 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1285 microversion: 2.20 time: 0.187336 Aug 10 16:55:17.488320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 24/58] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:17 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:17.683511 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d6cad504-5202-4316-b8fd-56ac98b297cf tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:17.684640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d6cad504-5202-4316-b8fd-56ac98b297cf tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:17.693367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cad504-5202-4316-b8fd-56ac98b297cf tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:17.694288 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cad504-5202-4316-b8fd-56ac98b297cf tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:17.695061 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cad504-5202-4316-b8fd-56ac98b297cf tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:17.696051 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cad504-5202-4316-b8fd-56ac98b297cf tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:17.696797 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cad504-5202-4316-b8fd-56ac98b297cf tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:17.697827 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cad504-5202-4316-b8fd-56ac98b297cf tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:17.707945 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-82bac508-479b-4231-938a-d07dc3cb24e7 req-53ad35bf-84ef-46ca-bf84-2f53e85c28e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8017eb-1d19-483c-b2ee-e5d8b07b16e9", "tag": "a1ea9959-841c-429c-a71e-74b97583bc3f"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:17.739668 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-82bac508-479b-4231-938a-d07dc3cb24e7 req-53ad35bf-84ef-46ca-bf84-2f53e85c28e4 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:17.740566 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-82bac508-479b-4231-938a-d07dc3cb24e7 req-53ad35bf-84ef-46ca-bf84-2f53e85c28e4 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:17.741410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-82bac508-479b-4231-938a-d07dc3cb24e7 req-53ad35bf-84ef-46ca-bf84-2f53e85c28e4 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:17.764353 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-82bac508-479b-4231-938a-d07dc3cb24e7 req-53ad35bf-84ef-46ca-bf84-2f53e85c28e4 service nova] Creating event network-changed:a1ea9959-841c-429c-a71e-74b97583bc3f for instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 on hv-cinder-83602 Aug 10 16:55:17.765005 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-82bac508-479b-4231-938a-d07dc3cb24e7 req-53ad35bf-84ef-46ca-bf84-2f53e85c28e4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120608) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 16:55:17.765963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-82bac508-479b-4231-938a-d07dc3cb24e7 req-53ad35bf-84ef-46ca-bf84-2f53e85c28e4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120608) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 16:55:17.766996 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf804f39-0943-4dfc-b3b9-ba3fb644f337 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:17.767619 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf804f39-0943-4dfc-b3b9-ba3fb644f337 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:17.770838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf804f39-0943-4dfc-b3b9-ba3fb644f337 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:17.776772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf804f39-0943-4dfc-b3b9-ba3fb644f337 None None] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:17.777960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf804f39-0943-4dfc-b3b9-ba3fb644f337 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:17.778416 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf804f39-0943-4dfc-b3b9-ba3fb644f337 None None] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:17.791220 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.compute.rpcapi [None req-bf804f39-0943-4dfc-b3b9-ba3fb644f337 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 16:55:17.792337 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf804f39-0943-4dfc-b3b9-ba3fb644f337 None None] Releasing lock "compute-rpcapi-router" {{(pid=120608) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 16:55:17.813375 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bf804f39-0943-4dfc-b3b9-ba3fb644f337 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285784 Aug 10 16:55:17.818688 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 35/59] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:55:17.941688 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c463b19c-a0e1-4da9-bbe9-6596027ca1c1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:17.943341 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c463b19c-a0e1-4da9-bbe9-6596027ca1c1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:17.954606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c463b19c-a0e1-4da9-bbe9-6596027ca1c1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:17.955360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c463b19c-a0e1-4da9-bbe9-6596027ca1c1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:17.956028 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c463b19c-a0e1-4da9-bbe9-6596027ca1c1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:17.958039 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d6cad504-5202-4316-b8fd-56ac98b297cf tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:17.958315 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c463b19c-a0e1-4da9-bbe9-6596027ca1c1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:17.959114 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c463b19c-a0e1-4da9-bbe9-6596027ca1c1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:17.960029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c463b19c-a0e1-4da9-bbe9-6596027ca1c1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:17.970117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d6cad504-5202-4316-b8fd-56ac98b297cf tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.290849 Aug 10 16:55:17.982693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 25/60] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:17 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:18.040963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c463b19c-a0e1-4da9-bbe9-6596027ca1c1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:18.049638 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c463b19c-a0e1-4da9-bbe9-6596027ca1c1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1298 microversion: 2.1 time: 0.114708 Aug 10 16:55:18.063454 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 36/61] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:17 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:18.197702 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b3ea26f-e5e6-4e3a-8753-f9eb25610818 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:18.198552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9b3ea26f-e5e6-4e3a-8753-f9eb25610818 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:18.212370 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b3ea26f-e5e6-4e3a-8753-f9eb25610818 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:18.212872 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b3ea26f-e5e6-4e3a-8753-f9eb25610818 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:18.213403 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b3ea26f-e5e6-4e3a-8753-f9eb25610818 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:18.214044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b3ea26f-e5e6-4e3a-8753-f9eb25610818 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:18.214551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b3ea26f-e5e6-4e3a-8753-f9eb25610818 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:18.215410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b3ea26f-e5e6-4e3a-8753-f9eb25610818 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:18.343574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b3ea26f-e5e6-4e3a-8753-f9eb25610818 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:18.353183 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b3ea26f-e5e6-4e3a-8753-f9eb25610818 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1280 microversion: 2.1 time: 0.171242 Aug 10 16:55:18.354214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 26/62] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:18 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1280 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:18.509291 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:18.510220 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:18.513520 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:18.517685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:18.518525 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:18.519059 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:18.520596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:18.521292 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:18.521891 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:18.610499 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:18.620778 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:18.622687 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:18.623803 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-81588176-ef6b-4332-8190-6d4a9c2ac5c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1285 microversion: 2.20 time: 0.118465 Aug 10 16:55:18.628192 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 37/63] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:18 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:18.804757 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1713925831", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b9d3b9d-33b4-42c3-8ca9-050f1e19ea7c"}], "security_groups": [{"name": "tempest-securitygroup--633867817"}], "key_name": "tempest-keypair-854479938", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:18.955621 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] validate_networks() for [('1b9d3b9d-33b4-42c3-8ca9-050f1e19ea7c', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:55:18.992032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b2b195b4-0ebb-4475-819a-b3efac61c5ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:18.992753 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b2b195b4-0ebb-4475-819a-b3efac61c5ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:19.005933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2b195b4-0ebb-4475-819a-b3efac61c5ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:19.013476 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2b195b4-0ebb-4475-819a-b3efac61c5ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:19.014316 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2b195b4-0ebb-4475-819a-b3efac61c5ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:19.016252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2b195b4-0ebb-4475-819a-b3efac61c5ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:19.017586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2b195b4-0ebb-4475-819a-b3efac61c5ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:19.018263 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2b195b4-0ebb-4475-819a-b3efac61c5ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:19.485689 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b2b195b4-0ebb-4475-819a-b3efac61c5ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:19.499190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b2b195b4-0ebb-4475-819a-b3efac61c5ee tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.511329 Aug 10 16:55:19.500111 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 38/64] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:18 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:19.505257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ad1b096f-e1ed-470c-bcbf-b85fd8ff6221 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:19.506190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ad1b096f-e1ed-470c-bcbf-b85fd8ff6221 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:19.518085 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad1b096f-e1ed-470c-bcbf-b85fd8ff6221 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:19.518868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad1b096f-e1ed-470c-bcbf-b85fd8ff6221 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:19.519531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad1b096f-e1ed-470c-bcbf-b85fd8ff6221 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:19.520810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad1b096f-e1ed-470c-bcbf-b85fd8ff6221 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:19.522727 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad1b096f-e1ed-470c-bcbf-b85fd8ff6221 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:19.523374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad1b096f-e1ed-470c-bcbf-b85fd8ff6221 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:19.548051 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:55:19.548659 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:55:19.549135 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:55:19.549755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:55:19.550275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:55:19.563363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:19.564109 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:19.564758 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:19.565701 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:19.566363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:19.566867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:19.597110 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Getting quotas for project c11dfd80b6c544f6b87a58d5a25c5649. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:55:19.602237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Getting quotas for user 77b8847d10744ec98e0ed7a3f1e991ed and project c11dfd80b6c544f6b87a58d5a25c5649. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:55:19.619493 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ad1b096f-e1ed-470c-bcbf-b85fd8ff6221 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:19.627367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:55:19.628184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:55:19.641486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ad1b096f-e1ed-470c-bcbf-b85fd8ff6221 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1298 microversion: 2.1 time: 0.139777 Aug 10 16:55:19.654632 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 39/65] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:19 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1298 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:19.654632 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2554bb8c-6c43-4f33-9feb-464387f0843a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:19.654632 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2554bb8c-6c43-4f33-9feb-464387f0843a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:19.663274 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2554bb8c-6c43-4f33-9feb-464387f0843a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:19.663727 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2554bb8c-6c43-4f33-9feb-464387f0843a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:19.670270 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2554bb8c-6c43-4f33-9feb-464387f0843a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:19.671289 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2554bb8c-6c43-4f33-9feb-464387f0843a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:19.671981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2554bb8c-6c43-4f33-9feb-464387f0843a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:19.672979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2554bb8c-6c43-4f33-9feb-464387f0843a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:19.695917 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:19.742739 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-803b7ad9-5771-490f-8432-639434afe137 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.935753 Aug 10 16:55:19.743468 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 27/66] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:55:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 16:55:19.759839 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:19.760414 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:19.779618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:19.782012 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:19.782477 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:19.783205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:19.783659 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:19.784078 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:19.789492 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2554bb8c-6c43-4f33-9feb-464387f0843a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:19.812853 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2554bb8c-6c43-4f33-9feb-464387f0843a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1280 microversion: 2.1 time: 0.169440 Aug 10 16:55:19.813642 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 40/67] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:19 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:19.835491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-801f9512-1233-45ab-9c8b-c630a629c5c6 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:19.836466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-801f9512-1233-45ab-9c8b-c630a629c5c6 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:19.898004 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:19.923637 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:19.931887 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:19.934770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-37c36ead-ee04-4231-af7c-bfebce050950 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1285 microversion: 2.20 time: 0.190331 Aug 10 16:55:19.944662 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 28/68] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:19 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:19.973242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-801f9512-1233-45ab-9c8b-c630a629c5c6 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:19.982360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-801f9512-1233-45ab-9c8b-c630a629c5c6 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1237 microversion: 2.1 time: 0.166885 Aug 10 16:55:19.983253 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 41/69] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:19 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1237 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:20.529039 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-111383b1-726c-4c5b-9e94-307e4437edc6 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:20.533920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-111383b1-726c-4c5b-9e94-307e4437edc6 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:20.545363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-111383b1-726c-4c5b-9e94-307e4437edc6 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:20.547535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-111383b1-726c-4c5b-9e94-307e4437edc6 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:20.547966 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-111383b1-726c-4c5b-9e94-307e4437edc6 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:20.549100 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-111383b1-726c-4c5b-9e94-307e4437edc6 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:20.549558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-111383b1-726c-4c5b-9e94-307e4437edc6 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:20.549986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-111383b1-726c-4c5b-9e94-307e4437edc6 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:20.662006 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-663c7261-c4cc-4fa7-9853-7c0405161b75 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:20.662616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-663c7261-c4cc-4fa7-9853-7c0405161b75 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:20.671726 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-663c7261-c4cc-4fa7-9853-7c0405161b75 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:20.673393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-663c7261-c4cc-4fa7-9853-7c0405161b75 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:20.676302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-663c7261-c4cc-4fa7-9853-7c0405161b75 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:20.677033 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-663c7261-c4cc-4fa7-9853-7c0405161b75 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:20.677489 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-663c7261-c4cc-4fa7-9853-7c0405161b75 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:20.677958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-663c7261-c4cc-4fa7-9853-7c0405161b75 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:20.765197 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-111383b1-726c-4c5b-9e94-307e4437edc6 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:20.780327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-663c7261-c4cc-4fa7-9853-7c0405161b75 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:20.782324 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-111383b1-726c-4c5b-9e94-307e4437edc6 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.264510 Aug 10 16:55:20.782905 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 29/70] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:20 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:20.803093 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-663c7261-c4cc-4fa7-9853-7c0405161b75 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1298 microversion: 2.1 time: 0.144743 Aug 10 16:55:20.808543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 42/71] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:20 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:20.836281 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-83e9f7e9-5ecd-49f1-b92f-50bb3ecc9b3b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:20.843424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-83e9f7e9-5ecd-49f1-b92f-50bb3ecc9b3b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:20.851298 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83e9f7e9-5ecd-49f1-b92f-50bb3ecc9b3b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:20.852866 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83e9f7e9-5ecd-49f1-b92f-50bb3ecc9b3b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:20.855683 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83e9f7e9-5ecd-49f1-b92f-50bb3ecc9b3b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:20.856813 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83e9f7e9-5ecd-49f1-b92f-50bb3ecc9b3b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:20.858240 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83e9f7e9-5ecd-49f1-b92f-50bb3ecc9b3b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:20.861040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83e9f7e9-5ecd-49f1-b92f-50bb3ecc9b3b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:20.958907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:20.959470 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:20.976542 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:20.977163 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:20.977471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:20.977577 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-83e9f7e9-5ecd-49f1-b92f-50bb3ecc9b3b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:20.978168 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:20.978635 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:20.979057 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:20.993971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-83e9f7e9-5ecd-49f1-b92f-50bb3ecc9b3b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1280 microversion: 2.1 time: 0.163697 Aug 10 16:55:20.994707 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 30/72] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:20 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:21.011908 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-70a9d6a6-ed89-43c9-9bae-eb0b25f5b27e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:21.012722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-70a9d6a6-ed89-43c9-9bae-eb0b25f5b27e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:21.033379 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70a9d6a6-ed89-43c9-9bae-eb0b25f5b27e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:21.033981 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70a9d6a6-ed89-43c9-9bae-eb0b25f5b27e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:21.034578 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70a9d6a6-ed89-43c9-9bae-eb0b25f5b27e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:21.035403 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70a9d6a6-ed89-43c9-9bae-eb0b25f5b27e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:21.035869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70a9d6a6-ed89-43c9-9bae-eb0b25f5b27e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:21.038025 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70a9d6a6-ed89-43c9-9bae-eb0b25f5b27e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:21.165290 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:21.175446 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:21.177148 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:21.179383 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-70a9d6a6-ed89-43c9-9bae-eb0b25f5b27e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:21.181597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ba80b8e5-c4a7-4fef-ad9c-ae9c00da8900 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1285 microversion: 2.20 time: 0.226489 Aug 10 16:55:21.182515 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 43/73] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:20 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:21.201050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-70a9d6a6-ed89-43c9-9bae-eb0b25f5b27e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1241 microversion: 2.1 time: 0.196095 Aug 10 16:55:21.212316 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 31/74] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:21 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1241 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:21.818817 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-af10d793-75bc-4dde-8bf7-e6cef92ca045 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:21.828135 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d5d53017-c240-41dc-8c16-4c9867a913c4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:21.830364 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d5d53017-c240-41dc-8c16-4c9867a913c4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:21.832796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-af10d793-75bc-4dde-8bf7-e6cef92ca045 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:21.853263 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5d53017-c240-41dc-8c16-4c9867a913c4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:21.855788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10d793-75bc-4dde-8bf7-e6cef92ca045 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:21.856563 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5d53017-c240-41dc-8c16-4c9867a913c4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:21.857216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5d53017-c240-41dc-8c16-4c9867a913c4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:21.859322 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10d793-75bc-4dde-8bf7-e6cef92ca045 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:21.859949 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10d793-75bc-4dde-8bf7-e6cef92ca045 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:21.860441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5d53017-c240-41dc-8c16-4c9867a913c4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:21.861016 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5d53017-c240-41dc-8c16-4c9867a913c4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:21.861218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10d793-75bc-4dde-8bf7-e6cef92ca045 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:21.861656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5d53017-c240-41dc-8c16-4c9867a913c4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:21.865106 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10d793-75bc-4dde-8bf7-e6cef92ca045 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:21.873503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10d793-75bc-4dde-8bf7-e6cef92ca045 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:21.981958 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d5d53017-c240-41dc-8c16-4c9867a913c4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:21.995184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d5d53017-c240-41dc-8c16-4c9867a913c4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1298 microversion: 2.1 time: 0.173665 Aug 10 16:55:21.997073 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 32/75] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:21 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1298 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:22.015817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f79f894-30b0-4624-af17-5aba058600d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:22.016659 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3f79f894-30b0-4624-af17-5aba058600d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:22.023628 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f79f894-30b0-4624-af17-5aba058600d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:22.024123 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f79f894-30b0-4624-af17-5aba058600d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:22.024752 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f79f894-30b0-4624-af17-5aba058600d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:22.033434 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f79f894-30b0-4624-af17-5aba058600d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:22.035094 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f79f894-30b0-4624-af17-5aba058600d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:22.036570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f79f894-30b0-4624-af17-5aba058600d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:22.083794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-af10d793-75bc-4dde-8bf7-e6cef92ca045 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:22.087425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:22.093380 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-af10d793-75bc-4dde-8bf7-e6cef92ca045 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.289777 Aug 10 16:55:22.093996 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 44/76] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:21 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:22.114066 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-3f79f894-30b0-4624-af17-5aba058600d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:22.121831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f79f894-30b0-4624-af17-5aba058600d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1280 microversion: 2.1 time: 0.109811 Aug 10 16:55:22.122936 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 33/77] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:22 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1280 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:22.205102 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:22.205710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:22.211742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:22.212259 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:22.212694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:22.213377 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:22.213847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:22.214875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:22.226379 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b2f34c9f-c61d-40d0-bfe9-1165390a9916 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:22.227180 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b2f34c9f-c61d-40d0-bfe9-1165390a9916 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:22.233131 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f34c9f-c61d-40d0-bfe9-1165390a9916 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:22.233623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f34c9f-c61d-40d0-bfe9-1165390a9916 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:22.234063 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f34c9f-c61d-40d0-bfe9-1165390a9916 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:22.234751 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f34c9f-c61d-40d0-bfe9-1165390a9916 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:22.235205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f34c9f-c61d-40d0-bfe9-1165390a9916 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:22.235665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f34c9f-c61d-40d0-bfe9-1165390a9916 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:22.278409 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:22.286227 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:22.287728 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:22.288872 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ddccfcbe-119a-4411-8b91-a2eb60cbfc23 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1285 microversion: 2.20 time: 0.087891 Aug 10 16:55:22.289429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 45/78] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:22 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:22.298704 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b2f34c9f-c61d-40d0-bfe9-1165390a9916 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:22.302079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:22.307097 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b2f34c9f-c61d-40d0-bfe9-1165390a9916 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1241 microversion: 2.1 time: 0.084614 Aug 10 16:55:22.307658 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 34/79] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:22 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:23.018139 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0add1ae9-2309-4dd7-b492-7da3d83c312e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:23.018821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0add1ae9-2309-4dd7-b492-7da3d83c312e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:23.024846 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0add1ae9-2309-4dd7-b492-7da3d83c312e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:23.025341 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0add1ae9-2309-4dd7-b492-7da3d83c312e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:23.025781 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0add1ae9-2309-4dd7-b492-7da3d83c312e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:23.026485 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0add1ae9-2309-4dd7-b492-7da3d83c312e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:23.027586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0add1ae9-2309-4dd7-b492-7da3d83c312e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:23.028030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0add1ae9-2309-4dd7-b492-7da3d83c312e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:23.100520 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0add1ae9-2309-4dd7-b492-7da3d83c312e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:23.108996 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0add1ae9-2309-4dd7-b492-7da3d83c312e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1298 microversion: 2.1 time: 0.094707 Aug 10 16:55:23.109981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 46/80] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:23 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:23.115047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9ae20a0b-575a-4595-946c-d48ac597a388 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:23.116189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9ae20a0b-575a-4595-946c-d48ac597a388 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:23.122656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae20a0b-575a-4595-946c-d48ac597a388 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:23.123526 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae20a0b-575a-4595-946c-d48ac597a388 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:23.123966 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae20a0b-575a-4595-946c-d48ac597a388 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:23.124690 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae20a0b-575a-4595-946c-d48ac597a388 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:23.125269 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae20a0b-575a-4595-946c-d48ac597a388 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:23.125738 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae20a0b-575a-4595-946c-d48ac597a388 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:23.154106 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4fd210b5-e3f2-492f-906e-4544eebcd052 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:23.154106 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4fd210b5-e3f2-492f-906e-4544eebcd052 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:23.154106 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fd210b5-e3f2-492f-906e-4544eebcd052 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:23.154106 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fd210b5-e3f2-492f-906e-4544eebcd052 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:23.154545 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fd210b5-e3f2-492f-906e-4544eebcd052 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:23.155392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fd210b5-e3f2-492f-906e-4544eebcd052 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:23.156094 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fd210b5-e3f2-492f-906e-4544eebcd052 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:23.156681 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fd210b5-e3f2-492f-906e-4544eebcd052 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:23.220902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4fd210b5-e3f2-492f-906e-4544eebcd052 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:23.232849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4fd210b5-e3f2-492f-906e-4544eebcd052 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1280 microversion: 2.1 time: 0.093855 Aug 10 16:55:23.233661 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 47/81] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:23 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:23.260671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ae20a0b-575a-4595-946c-d48ac597a388 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:23.268038 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9ae20a0b-575a-4595-946c-d48ac597a388 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.156949 Aug 10 16:55:23.268629 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 35/82] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:23 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:23.311231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:23.311841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:23.318279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:23.318769 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:23.319198 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:23.319918 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:23.320451 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:23.321254 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:23.328229 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ad128de-d3fb-4221-908d-ceb1a5ed7826 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:23.328853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ad128de-d3fb-4221-908d-ceb1a5ed7826 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:23.335188 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ad128de-d3fb-4221-908d-ceb1a5ed7826 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:23.336065 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ad128de-d3fb-4221-908d-ceb1a5ed7826 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:23.336787 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ad128de-d3fb-4221-908d-ceb1a5ed7826 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:23.337701 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ad128de-d3fb-4221-908d-ceb1a5ed7826 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:23.338360 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ad128de-d3fb-4221-908d-ceb1a5ed7826 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:23.339001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ad128de-d3fb-4221-908d-ceb1a5ed7826 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:23.384344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:23.393092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:23.394601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:23.395716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-41e91fe4-116f-4a81-9ecc-784c6e384978 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1285 microversion: 2.20 time: 0.088790 Aug 10 16:55:23.396465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 48/83] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:23 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:23.407261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6ad128de-d3fb-4221-908d-ceb1a5ed7826 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:23.415639 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ad128de-d3fb-4221-908d-ceb1a5ed7826 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1241 microversion: 2.1 time: 0.092001 Aug 10 16:55:23.416542 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 36/84] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:23 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:24.129639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-858ae12d-b254-4d3b-9299-6eadcac890e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:24.130226 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-858ae12d-b254-4d3b-9299-6eadcac890e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:24.136742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858ae12d-b254-4d3b-9299-6eadcac890e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:24.137219 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858ae12d-b254-4d3b-9299-6eadcac890e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:24.137642 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858ae12d-b254-4d3b-9299-6eadcac890e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:24.138314 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858ae12d-b254-4d3b-9299-6eadcac890e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:24.138758 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858ae12d-b254-4d3b-9299-6eadcac890e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:24.139173 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858ae12d-b254-4d3b-9299-6eadcac890e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:24.203138 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-858ae12d-b254-4d3b-9299-6eadcac890e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:24.210766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-858ae12d-b254-4d3b-9299-6eadcac890e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1298 microversion: 2.1 time: 0.085061 Aug 10 16:55:24.211327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 49/85] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:24 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:24.252686 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a1fe761-d9b4-4cde-afac-a5c70e429be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:24.253298 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a1fe761-d9b4-4cde-afac-a5c70e429be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:24.259261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a1fe761-d9b4-4cde-afac-a5c70e429be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:24.259741 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a1fe761-d9b4-4cde-afac-a5c70e429be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:24.260193 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a1fe761-d9b4-4cde-afac-a5c70e429be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:24.260912 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a1fe761-d9b4-4cde-afac-a5c70e429be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:24.261358 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a1fe761-d9b4-4cde-afac-a5c70e429be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:24.261803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a1fe761-d9b4-4cde-afac-a5c70e429be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:24.288753 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7d04bff8-1b2c-47a3-b54b-24bdc3fbc956 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:24.289392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7d04bff8-1b2c-47a3-b54b-24bdc3fbc956 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:24.295825 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d04bff8-1b2c-47a3-b54b-24bdc3fbc956 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:24.296346 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d04bff8-1b2c-47a3-b54b-24bdc3fbc956 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:24.296818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d04bff8-1b2c-47a3-b54b-24bdc3fbc956 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:24.297505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d04bff8-1b2c-47a3-b54b-24bdc3fbc956 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:24.297958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d04bff8-1b2c-47a3-b54b-24bdc3fbc956 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:24.298475 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d04bff8-1b2c-47a3-b54b-24bdc3fbc956 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:24.322237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8a1fe761-d9b4-4cde-afac-a5c70e429be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:24.329793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a1fe761-d9b4-4cde-afac-a5c70e429be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1280 microversion: 2.1 time: 0.080862 Aug 10 16:55:24.330302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 37/86] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:24 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:24.424164 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:24.424435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7d04bff8-1b2c-47a3-b54b-24bdc3fbc956 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:24.424796 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:24.431422 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:24.431916 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:24.432532 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:24.432652 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7d04bff8-1b2c-47a3-b54b-24bdc3fbc956 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.147517 Aug 10 16:55:24.433767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:24.439347 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 50/87] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:24 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:24.439483 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:24.439483 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:24.439660 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-95b314de-8649-4427-8fef-1f86e154f2b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:24.439660 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-95b314de-8649-4427-8fef-1f86e154f2b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:24.445145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95b314de-8649-4427-8fef-1f86e154f2b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:24.445627 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95b314de-8649-4427-8fef-1f86e154f2b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:24.446052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95b314de-8649-4427-8fef-1f86e154f2b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:24.446732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95b314de-8649-4427-8fef-1f86e154f2b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:24.447176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95b314de-8649-4427-8fef-1f86e154f2b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:24.447593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95b314de-8649-4427-8fef-1f86e154f2b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:24.501866 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:24.510326 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:24.510640 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-95b314de-8649-4427-8fef-1f86e154f2b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:24.512517 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:24.513981 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-09a0ce4b-db32-4184-b524-13cd55665b12 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1285 microversion: 2.20 time: 0.093699 Aug 10 16:55:24.514550 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 38/88] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:24 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:24.518467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-95b314de-8649-4427-8fef-1f86e154f2b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1241 microversion: 2.1 time: 0.083719 Aug 10 16:55:24.519105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 51/89] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:24 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:25.230906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ef9b6294-82d7-48b5-83da-b8e21d3d0289 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:25.231516 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ef9b6294-82d7-48b5-83da-b8e21d3d0289 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:25.237506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef9b6294-82d7-48b5-83da-b8e21d3d0289 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:25.237989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef9b6294-82d7-48b5-83da-b8e21d3d0289 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:25.238453 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef9b6294-82d7-48b5-83da-b8e21d3d0289 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:25.239234 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef9b6294-82d7-48b5-83da-b8e21d3d0289 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:25.239691 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef9b6294-82d7-48b5-83da-b8e21d3d0289 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:25.240115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef9b6294-82d7-48b5-83da-b8e21d3d0289 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:25.300117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ef9b6294-82d7-48b5-83da-b8e21d3d0289 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:25.307478 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ef9b6294-82d7-48b5-83da-b8e21d3d0289 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1298 microversion: 2.1 time: 0.080453 Aug 10 16:55:25.308558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 39/90] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:25 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1298 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:25.350622 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1fbd37bf-e662-4a40-87ce-a30d46adbe43 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:25.351234 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1fbd37bf-e662-4a40-87ce-a30d46adbe43 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:25.356981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fbd37bf-e662-4a40-87ce-a30d46adbe43 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:25.357456 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fbd37bf-e662-4a40-87ce-a30d46adbe43 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:25.357879 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fbd37bf-e662-4a40-87ce-a30d46adbe43 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:25.358552 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fbd37bf-e662-4a40-87ce-a30d46adbe43 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:25.358994 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fbd37bf-e662-4a40-87ce-a30d46adbe43 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:25.359409 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fbd37bf-e662-4a40-87ce-a30d46adbe43 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:25.418870 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1fbd37bf-e662-4a40-87ce-a30d46adbe43 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:25.426283 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1fbd37bf-e662-4a40-87ce-a30d46adbe43 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1280 microversion: 2.1 time: 0.079454 Aug 10 16:55:25.426839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 52/91] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:25 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:25.454120 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e53a53ae-8d36-4262-ab14-29dcec7610bc tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:25.454662 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e53a53ae-8d36-4262-ab14-29dcec7610bc tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:25.460887 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e53a53ae-8d36-4262-ab14-29dcec7610bc tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:25.461371 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e53a53ae-8d36-4262-ab14-29dcec7610bc tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:25.461808 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e53a53ae-8d36-4262-ab14-29dcec7610bc tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:25.462487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e53a53ae-8d36-4262-ab14-29dcec7610bc tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:25.462940 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e53a53ae-8d36-4262-ab14-29dcec7610bc tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:25.463357 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e53a53ae-8d36-4262-ab14-29dcec7610bc tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:25.536887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:25.537524 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:25.543533 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:25.544037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:25.544485 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:25.545172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:25.545620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:25.546039 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:25.591312 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e53a53ae-8d36-4262-ab14-29dcec7610bc tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:25.598769 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e53a53ae-8d36-4262-ab14-29dcec7610bc tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.148526 Aug 10 16:55:25.599375 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 40/92] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:25 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:25.603928 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9ccf6ea-210b-4c91-847d-258596cc648f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:25.604554 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c9ccf6ea-210b-4c91-847d-258596cc648f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:25.610251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ccf6ea-210b-4c91-847d-258596cc648f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:25.610733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ccf6ea-210b-4c91-847d-258596cc648f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:25.611017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:25.611167 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ccf6ea-210b-4c91-847d-258596cc648f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:25.612021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ccf6ea-210b-4c91-847d-258596cc648f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:25.612340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ccf6ea-210b-4c91-847d-258596cc648f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:25.612761 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ccf6ea-210b-4c91-847d-258596cc648f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:25.619064 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:25.621096 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:25.622190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-165e835e-88fd-4569-9f9a-f8f10aad163e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1285 microversion: 2.20 time: 0.089389 Aug 10 16:55:25.622739 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 53/93] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:25 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:25.675115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c9ccf6ea-210b-4c91-847d-258596cc648f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:25.682431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c9ccf6ea-210b-4c91-847d-258596cc648f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1241 microversion: 2.1 time: 0.081988 Aug 10 16:55:25.683580 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 41/94] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:25 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:26.328364 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d8280bc1-8da2-4572-b0d7-f751342f0d5f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:26.328972 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d8280bc1-8da2-4572-b0d7-f751342f0d5f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:26.335204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8280bc1-8da2-4572-b0d7-f751342f0d5f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:26.335685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8280bc1-8da2-4572-b0d7-f751342f0d5f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:26.336112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8280bc1-8da2-4572-b0d7-f751342f0d5f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:26.336812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8280bc1-8da2-4572-b0d7-f751342f0d5f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:26.337255 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8280bc1-8da2-4572-b0d7-f751342f0d5f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:26.337665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8280bc1-8da2-4572-b0d7-f751342f0d5f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:26.402854 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d8280bc1-8da2-4572-b0d7-f751342f0d5f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:26.410596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d8280bc1-8da2-4572-b0d7-f751342f0d5f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1298 microversion: 2.1 time: 0.086052 Aug 10 16:55:26.411162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 54/95] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:26 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:26.446582 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8ceef0c7-0a94-4882-b95d-01f38977c96b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:26.447190 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8ceef0c7-0a94-4882-b95d-01f38977c96b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:26.453619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ceef0c7-0a94-4882-b95d-01f38977c96b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:26.454099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ceef0c7-0a94-4882-b95d-01f38977c96b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:26.454529 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ceef0c7-0a94-4882-b95d-01f38977c96b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:26.455206 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ceef0c7-0a94-4882-b95d-01f38977c96b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:26.455652 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ceef0c7-0a94-4882-b95d-01f38977c96b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:26.456070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ceef0c7-0a94-4882-b95d-01f38977c96b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:26.517273 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8ceef0c7-0a94-4882-b95d-01f38977c96b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:26.525504 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8ceef0c7-0a94-4882-b95d-01f38977c96b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1280 microversion: 2.1 time: 0.082427 Aug 10 16:55:26.526106 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 42/96] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:26 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:26.620176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-947df8b7-c040-4ffd-b227-1caabc1ea806 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:26.620810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-947df8b7-c040-4ffd-b227-1caabc1ea806 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:26.626781 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-947df8b7-c040-4ffd-b227-1caabc1ea806 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:26.627344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-947df8b7-c040-4ffd-b227-1caabc1ea806 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:26.627781 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-947df8b7-c040-4ffd-b227-1caabc1ea806 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:26.628494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-947df8b7-c040-4ffd-b227-1caabc1ea806 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:26.628948 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-947df8b7-c040-4ffd-b227-1caabc1ea806 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:26.629370 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-947df8b7-c040-4ffd-b227-1caabc1ea806 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:26.647940 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:26.648980 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:26.656488 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:26.657476 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:26.657476 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:26.658164 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:26.658783 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:26.659216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:26.721377 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:26.731725 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:26.733446 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:26.734564 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5088abc6-2f70-4be9-a30f-dfdf72dd7a13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1285 microversion: 2.20 time: 0.093434 Aug 10 16:55:26.735129 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 43/97] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:26 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:26.752969 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4924877-dac4-4aa7-8c4e-8c6024ed2a81 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:26.753588 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4924877-dac4-4aa7-8c4e-8c6024ed2a81 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:26.760557 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4924877-dac4-4aa7-8c4e-8c6024ed2a81 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:26.761619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4924877-dac4-4aa7-8c4e-8c6024ed2a81 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:26.762109 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4924877-dac4-4aa7-8c4e-8c6024ed2a81 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:26.762834 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4924877-dac4-4aa7-8c4e-8c6024ed2a81 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:26.763290 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4924877-dac4-4aa7-8c4e-8c6024ed2a81 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:26.763728 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4924877-dac4-4aa7-8c4e-8c6024ed2a81 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:26.826405 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4924877-dac4-4aa7-8c4e-8c6024ed2a81 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:26.834732 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4924877-dac4-4aa7-8c4e-8c6024ed2a81 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1241 microversion: 2.1 time: 0.085457 Aug 10 16:55:26.835625 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 44/98] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:26 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:26.947019 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-947df8b7-c040-4ffd-b227-1caabc1ea806 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:26.958811 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-947df8b7-c040-4ffd-b227-1caabc1ea806 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.343075 Aug 10 16:55:26.959402 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 55/99] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:26 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:27.430999 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8cae5cdc-afbe-46eb-a11c-1b275a388a20 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:27.431907 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8cae5cdc-afbe-46eb-a11c-1b275a388a20 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:27.441293 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cae5cdc-afbe-46eb-a11c-1b275a388a20 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:27.442831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cae5cdc-afbe-46eb-a11c-1b275a388a20 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:27.443437 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cae5cdc-afbe-46eb-a11c-1b275a388a20 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:27.444390 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cae5cdc-afbe-46eb-a11c-1b275a388a20 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:27.444951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cae5cdc-afbe-46eb-a11c-1b275a388a20 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:27.445600 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cae5cdc-afbe-46eb-a11c-1b275a388a20 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:27.534546 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8cae5cdc-afbe-46eb-a11c-1b275a388a20 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:27.552234 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-50c108c9-fa18-4e5b-a02b-c9d6ea155f3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:27.553918 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-50c108c9-fa18-4e5b-a02b-c9d6ea155f3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:27.563606 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8cae5cdc-afbe-46eb-a11c-1b275a388a20 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1298 microversion: 2.1 time: 0.135600 Aug 10 16:55:27.564766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50c108c9-fa18-4e5b-a02b-c9d6ea155f3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:27.565730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 45/100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:27 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:27.566512 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50c108c9-fa18-4e5b-a02b-c9d6ea155f3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:27.567101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50c108c9-fa18-4e5b-a02b-c9d6ea155f3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:27.568265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50c108c9-fa18-4e5b-a02b-c9d6ea155f3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:27.568864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50c108c9-fa18-4e5b-a02b-c9d6ea155f3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:27.569453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50c108c9-fa18-4e5b-a02b-c9d6ea155f3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:27.765292 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:27.765904 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:27.781180 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:27.781890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:27.784312 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:27.785223 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:27.788621 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:27.789218 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:27.789509 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=8 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:27.882835 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:27.892416 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:27.892676 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-50c108c9-fa18-4e5b-a02b-c9d6ea155f3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:27.893929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:27.895042 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4af3799-f179-415d-aacc-486e29e3c018 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1333 microversion: 2.20 time: 0.137893 Aug 10 16:55:27.895608 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 46/101] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:27 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1333 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:27.902854 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-50c108c9-fa18-4e5b-a02b-c9d6ea155f3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.355868 Aug 10 16:55:27.904613 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 56/102] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:27 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:27.919240 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-81a4a32d-c532-44d3-8f3d-e1418f9195fd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:27.919850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-81a4a32d-c532-44d3-8f3d-e1418f9195fd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:27.928593 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81a4a32d-c532-44d3-8f3d-e1418f9195fd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:27.929568 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81a4a32d-c532-44d3-8f3d-e1418f9195fd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:27.930558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81a4a32d-c532-44d3-8f3d-e1418f9195fd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:27.931840 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81a4a32d-c532-44d3-8f3d-e1418f9195fd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:27.932507 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81a4a32d-c532-44d3-8f3d-e1418f9195fd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:27.933153 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81a4a32d-c532-44d3-8f3d-e1418f9195fd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:27.978913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-65d093e8-aedc-475e-9904-71a617582560 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:27.979443 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-65d093e8-aedc-475e-9904-71a617582560 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:28.020052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65d093e8-aedc-475e-9904-71a617582560 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:28.020572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65d093e8-aedc-475e-9904-71a617582560 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:28.021012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65d093e8-aedc-475e-9904-71a617582560 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:28.021724 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65d093e8-aedc-475e-9904-71a617582560 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:28.022179 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65d093e8-aedc-475e-9904-71a617582560 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:28.022601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65d093e8-aedc-475e-9904-71a617582560 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:28.277225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-81a4a32d-c532-44d3-8f3d-e1418f9195fd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:28.286519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-81a4a32d-c532-44d3-8f3d-e1418f9195fd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1289 microversion: 2.1 time: 0.374459 Aug 10 16:55:28.292076 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 47/103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:27 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1289 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:28.590297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-38346c53-f260-4cc8-95ec-a720721a7907 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:28.591109 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-38346c53-f260-4cc8-95ec-a720721a7907 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:28.601819 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38346c53-f260-4cc8-95ec-a720721a7907 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:28.602466 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38346c53-f260-4cc8-95ec-a720721a7907 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:28.602978 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38346c53-f260-4cc8-95ec-a720721a7907 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:28.603771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38346c53-f260-4cc8-95ec-a720721a7907 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:28.604257 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38346c53-f260-4cc8-95ec-a720721a7907 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:28.604764 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38346c53-f260-4cc8-95ec-a720721a7907 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:28.844448 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-38346c53-f260-4cc8-95ec-a720721a7907 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:28.850212 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-38346c53-f260-4cc8-95ec-a720721a7907 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.266428 Aug 10 16:55:28.850953 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 48/104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:28 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:28.867687 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-65d093e8-aedc-475e-9904-71a617582560 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:28.876441 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-65d093e8-aedc-475e-9904-71a617582560 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.901325 Aug 10 16:55:28.877561 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 57/105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:27 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:28.920635 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:28.928216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:28.933845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5434008b-d7fd-4edf-a749-a2c4570ad79e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:28.934550 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5434008b-d7fd-4edf-a749-a2c4570ad79e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:28.945460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5434008b-d7fd-4edf-a749-a2c4570ad79e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:28.946647 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5434008b-d7fd-4edf-a749-a2c4570ad79e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:28.947883 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5434008b-d7fd-4edf-a749-a2c4570ad79e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:28.949579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5434008b-d7fd-4edf-a749-a2c4570ad79e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:28.951215 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5434008b-d7fd-4edf-a749-a2c4570ad79e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:28.951863 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5434008b-d7fd-4edf-a749-a2c4570ad79e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:28.956643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:28.957152 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:28.957937 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:28.975243 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:28.978583 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:28.985624 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:29.124192 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:29.137129 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:29.138859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:29.140256 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f02703ca-99d5-4d8d-9d73-937be9f570cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1339 microversion: 2.20 time: 0.225364 Aug 10 16:55:29.155645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 49/106] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:28 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1339 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:29.311413 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-23c39c40-dfff-4d64-824d-6f0728d80356 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:29.312036 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-23c39c40-dfff-4d64-824d-6f0728d80356 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:29.322144 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c39c40-dfff-4d64-824d-6f0728d80356 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:29.322643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c39c40-dfff-4d64-824d-6f0728d80356 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:29.323084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c39c40-dfff-4d64-824d-6f0728d80356 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:29.329227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c39c40-dfff-4d64-824d-6f0728d80356 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:29.330002 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c39c40-dfff-4d64-824d-6f0728d80356 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:29.330703 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c39c40-dfff-4d64-824d-6f0728d80356 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:29.486181 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-23c39c40-dfff-4d64-824d-6f0728d80356 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:29.493627 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-23c39c40-dfff-4d64-824d-6f0728d80356 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1295 microversion: 2.1 time: 0.186764 Aug 10 16:55:29.494200 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 50/107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:29 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1295 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:29.588420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5434008b-d7fd-4edf-a749-a2c4570ad79e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:29.597151 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5434008b-d7fd-4edf-a749-a2c4570ad79e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.672863 Aug 10 16:55:29.597732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 58/108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:28 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:29.871546 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c09fcf3b-2085-4cc1-aa64-3bb97738aea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:29.872005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c09fcf3b-2085-4cc1-aa64-3bb97738aea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:29.873806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:29.874467 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=30 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:29.886460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c09fcf3b-2085-4cc1-aa64-3bb97738aea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:29.887243 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c09fcf3b-2085-4cc1-aa64-3bb97738aea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:29.902589 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8093d1ed-6579-46f8-9b82-e68518fecbf3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:29.903136 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c09fcf3b-2085-4cc1-aa64-3bb97738aea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:29.903899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8093d1ed-6579-46f8-9b82-e68518fecbf3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:29.904300 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c09fcf3b-2085-4cc1-aa64-3bb97738aea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:29.904976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c09fcf3b-2085-4cc1-aa64-3bb97738aea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:29.906688 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c09fcf3b-2085-4cc1-aa64-3bb97738aea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:29.911276 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8093d1ed-6579-46f8-9b82-e68518fecbf3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:29.921057 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8093d1ed-6579-46f8-9b82-e68518fecbf3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:29.921672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8093d1ed-6579-46f8-9b82-e68518fecbf3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:29.922573 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8093d1ed-6579-46f8-9b82-e68518fecbf3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:29.923305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8093d1ed-6579-46f8-9b82-e68518fecbf3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:29.924052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8093d1ed-6579-46f8-9b82-e68518fecbf3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:29.948438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:29.989271 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=32 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:30.235160 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c09fcf3b-2085-4cc1-aa64-3bb97738aea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:30.247982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c09fcf3b-2085-4cc1-aa64-3bb97738aea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.380314 Aug 10 16:55:30.248932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 51/109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:29 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:30.258510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:30.259607 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:30.269223 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:30.272586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:30.273003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:30.273741 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:30.274254 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:30.274675 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:30.380498 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:30.393842 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:30.397025 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:30.398283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-780d8b3e-3789-4e89-b80e-480bcdb4f375 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1339 microversion: 2.20 time: 0.148035 Aug 10 16:55:30.399133 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 52/110] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:30 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1339 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:30.506875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8093d1ed-6579-46f8-9b82-e68518fecbf3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:30.515386 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ef165d77-4dcc-4360-91a6-809a2668aedd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:30.515569 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8093d1ed-6579-46f8-9b82-e68518fecbf3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.617197 Aug 10 16:55:30.516174 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ef165d77-4dcc-4360-91a6-809a2668aedd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:30.528171 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 59/111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:29 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:30.528844 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef165d77-4dcc-4360-91a6-809a2668aedd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:30.528844 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef165d77-4dcc-4360-91a6-809a2668aedd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:30.528844 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef165d77-4dcc-4360-91a6-809a2668aedd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:30.529434 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef165d77-4dcc-4360-91a6-809a2668aedd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:30.530230 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef165d77-4dcc-4360-91a6-809a2668aedd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:30.530851 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef165d77-4dcc-4360-91a6-809a2668aedd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:30.619994 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b0150d1c-c88d-4a40-81f2-4a63c9048e16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:30.621322 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b0150d1c-c88d-4a40-81f2-4a63c9048e16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:30.628654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0150d1c-c88d-4a40-81f2-4a63c9048e16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:30.629753 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0150d1c-c88d-4a40-81f2-4a63c9048e16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:30.630431 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0150d1c-c88d-4a40-81f2-4a63c9048e16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:30.632574 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0150d1c-c88d-4a40-81f2-4a63c9048e16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:30.634304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0150d1c-c88d-4a40-81f2-4a63c9048e16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:30.635110 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0150d1c-c88d-4a40-81f2-4a63c9048e16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:30.679859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ef165d77-4dcc-4360-91a6-809a2668aedd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:30.688592 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ef165d77-4dcc-4360-91a6-809a2668aedd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.177441 Aug 10 16:55:30.689110 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 53/112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:30 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:31.119139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a28165d7-8d02-4211-ab32-97779e7d6dfd req-b393330b-1369-41d9-a6cf-22049fdaf5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993a10bf-b49d-4027-b117-d167712152e0", "tag": "0a60f022-b759-4dc7-8144-208e6c5d1ad3"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:31.131103 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a28165d7-8d02-4211-ab32-97779e7d6dfd req-b393330b-1369-41d9-a6cf-22049fdaf5a4 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:31.131707 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a28165d7-8d02-4211-ab32-97779e7d6dfd req-b393330b-1369-41d9-a6cf-22049fdaf5a4 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:31.132249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a28165d7-8d02-4211-ab32-97779e7d6dfd req-b393330b-1369-41d9-a6cf-22049fdaf5a4 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:31.144208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a28165d7-8d02-4211-ab32-97779e7d6dfd req-b393330b-1369-41d9-a6cf-22049fdaf5a4 service nova] Creating event network-changed:0a60f022-b759-4dc7-8144-208e6c5d1ad3 for instance 993a10bf-b49d-4027-b117-d167712152e0 on hv-cinder-83602 Aug 10 16:55:31.149452 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a28165d7-8d02-4211-ab32-97779e7d6dfd req-b393330b-1369-41d9-a6cf-22049fdaf5a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038443 Aug 10 16:55:31.150506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 54/113] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:55:31.233355 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b0150d1c-c88d-4a40-81f2-4a63c9048e16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:31.243885 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b0150d1c-c88d-4a40-81f2-4a63c9048e16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.629225 Aug 10 16:55:31.244804 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 60/114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:30 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:31.274195 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dba5079e-ad58-4cf3-8bee-2d6ec907e22b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:31.275539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dba5079e-ad58-4cf3-8bee-2d6ec907e22b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:31.283296 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba5079e-ad58-4cf3-8bee-2d6ec907e22b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:31.284077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba5079e-ad58-4cf3-8bee-2d6ec907e22b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:31.284581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba5079e-ad58-4cf3-8bee-2d6ec907e22b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:31.285315 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba5079e-ad58-4cf3-8bee-2d6ec907e22b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:31.285767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba5079e-ad58-4cf3-8bee-2d6ec907e22b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:31.286190 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba5079e-ad58-4cf3-8bee-2d6ec907e22b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:31.429585 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:31.430856 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:31.438830 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:31.440502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:31.441519 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:31.442926 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:31.443004 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:31.443423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:31.473323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:31.494900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dba5079e-ad58-4cf3-8bee-2d6ec907e22b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:31.506464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dba5079e-ad58-4cf3-8bee-2d6ec907e22b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.237538 Aug 10 16:55:31.507410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 55/115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:31 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:31.545106 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6c5dd30d-c70e-48dd-a73c-3f408ac6832a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:31.548004 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6c5dd30d-c70e-48dd-a73c-3f408ac6832a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:31.563202 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5dd30d-c70e-48dd-a73c-3f408ac6832a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:31.564241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5dd30d-c70e-48dd-a73c-3f408ac6832a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:31.566907 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5dd30d-c70e-48dd-a73c-3f408ac6832a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:31.568791 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5dd30d-c70e-48dd-a73c-3f408ac6832a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:31.569749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5dd30d-c70e-48dd-a73c-3f408ac6832a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:31.571383 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5dd30d-c70e-48dd-a73c-3f408ac6832a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:31.670903 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:31.681562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:31.683835 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:31.685428 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d1e84ccf-8a04-43ba-9f01-2afbf2f9c8ec tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.265911 Aug 10 16:55:31.688622 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 61/116] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:31 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:31.711904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5527b032-7adb-4475-a057-9304b067b636 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:31.712688 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5527b032-7adb-4475-a057-9304b067b636 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:31.721510 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5527b032-7adb-4475-a057-9304b067b636 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:31.722226 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5527b032-7adb-4475-a057-9304b067b636 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:31.722821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5527b032-7adb-4475-a057-9304b067b636 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:31.724119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5527b032-7adb-4475-a057-9304b067b636 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:31.724611 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5527b032-7adb-4475-a057-9304b067b636 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:31.725041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5527b032-7adb-4475-a057-9304b067b636 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:31.759305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6c5dd30d-c70e-48dd-a73c-3f408ac6832a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:31.768922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6c5dd30d-c70e-48dd-a73c-3f408ac6832a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.233104 Aug 10 16:55:31.770200 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 56/117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:31 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:31.884270 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5527b032-7adb-4475-a057-9304b067b636 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:31.893180 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5527b032-7adb-4475-a057-9304b067b636 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.186687 Aug 10 16:55:31.896176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 62/118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:31 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:32.273681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2470629b-27a7-464e-9acb-681bea3442d2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:32.275533 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2470629b-27a7-464e-9acb-681bea3442d2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:32.283667 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2470629b-27a7-464e-9acb-681bea3442d2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:32.286162 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2470629b-27a7-464e-9acb-681bea3442d2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:32.288021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2470629b-27a7-464e-9acb-681bea3442d2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:32.288955 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2470629b-27a7-464e-9acb-681bea3442d2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:32.289535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2470629b-27a7-464e-9acb-681bea3442d2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:32.290050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2470629b-27a7-464e-9acb-681bea3442d2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:32.442336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2470629b-27a7-464e-9acb-681bea3442d2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:32.461462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2470629b-27a7-464e-9acb-681bea3442d2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.192456 Aug 10 16:55:32.462445 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 57/119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:32 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:32.529908 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a9c59c88-81c3-4f7b-a8cd-ae8fee5d9b0b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:32.531160 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a9c59c88-81c3-4f7b-a8cd-ae8fee5d9b0b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:32.539881 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9c59c88-81c3-4f7b-a8cd-ae8fee5d9b0b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:32.540682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9c59c88-81c3-4f7b-a8cd-ae8fee5d9b0b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:32.541181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9c59c88-81c3-4f7b-a8cd-ae8fee5d9b0b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:32.542716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9c59c88-81c3-4f7b-a8cd-ae8fee5d9b0b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:32.543450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9c59c88-81c3-4f7b-a8cd-ae8fee5d9b0b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:32.543952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9c59c88-81c3-4f7b-a8cd-ae8fee5d9b0b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:32.708448 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:32.709054 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:32.717099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:32.717595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:32.718032 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:32.718740 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:32.719192 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:32.719619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:33.204176 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:33.220854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:33.223598 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:33.236078 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-15e1ea0d-14d7-4519-ad20-c4b0b0764e9e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.531820 Aug 10 16:55:33.237079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 58/120] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:32 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:33.245052 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-31d5bebd-dd92-4f60-ab56-394622926f83 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:33.246133 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-31d5bebd-dd92-4f60-ab56-394622926f83 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:33.253179 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31d5bebd-dd92-4f60-ab56-394622926f83 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:33.253954 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31d5bebd-dd92-4f60-ab56-394622926f83 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:33.254810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31d5bebd-dd92-4f60-ab56-394622926f83 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:33.255754 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31d5bebd-dd92-4f60-ab56-394622926f83 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:33.256323 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31d5bebd-dd92-4f60-ab56-394622926f83 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:33.256823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31d5bebd-dd92-4f60-ab56-394622926f83 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:33.314404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a9c59c88-81c3-4f7b-a8cd-ae8fee5d9b0b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:33.324950 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a9c59c88-81c3-4f7b-a8cd-ae8fee5d9b0b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.801424 Aug 10 16:55:33.326483 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 63/121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:32 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:33.334298 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7a9654ee-e86d-4fbc-b584-8d0dc8e5c0cb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:33.335364 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7a9654ee-e86d-4fbc-b584-8d0dc8e5c0cb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:33.346482 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a9654ee-e86d-4fbc-b584-8d0dc8e5c0cb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:33.347262 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a9654ee-e86d-4fbc-b584-8d0dc8e5c0cb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:33.348031 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a9654ee-e86d-4fbc-b584-8d0dc8e5c0cb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:33.349053 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a9654ee-e86d-4fbc-b584-8d0dc8e5c0cb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:33.349731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a9654ee-e86d-4fbc-b584-8d0dc8e5c0cb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:33.350720 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a9654ee-e86d-4fbc-b584-8d0dc8e5c0cb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:33.510352 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-31d5bebd-dd92-4f60-ab56-394622926f83 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:33.520181 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-31d5bebd-dd92-4f60-ab56-394622926f83 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.281403 Aug 10 16:55:33.520640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 59/122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:33 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:33.525015 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f4c6a0e8-008a-4570-9af1-28f035f3ce04 req-bcd5592d-4919-4122-991c-5eacbba9079a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47c5a69-d424-4029-aa71-d2a0375d20cf", "tag": "df7c9811-d38c-42e7-af16-56a3efaa2ab9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:33.543619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f4c6a0e8-008a-4570-9af1-28f035f3ce04 req-bcd5592d-4919-4122-991c-5eacbba9079a service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:33.544342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f4c6a0e8-008a-4570-9af1-28f035f3ce04 req-bcd5592d-4919-4122-991c-5eacbba9079a service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:33.544958 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f4c6a0e8-008a-4570-9af1-28f035f3ce04 req-bcd5592d-4919-4122-991c-5eacbba9079a service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:33.560238 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f4c6a0e8-008a-4570-9af1-28f035f3ce04 req-bcd5592d-4919-4122-991c-5eacbba9079a service nova] Creating event network-changed:df7c9811-d38c-42e7-af16-56a3efaa2ab9 for instance a47c5a69-d424-4029-aa71-d2a0375d20cf on hv-cinder-83602 Aug 10 16:55:33.567867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f4c6a0e8-008a-4570-9af1-28f035f3ce04 req-bcd5592d-4919-4122-991c-5eacbba9079a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046067 Aug 10 16:55:33.571306 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 60/123] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:55:33.581082 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06a9e44d-08cd-4de6-b701-591d007e2d4f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:33.581785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-06a9e44d-08cd-4de6-b701-591d007e2d4f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:33.598455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06a9e44d-08cd-4de6-b701-591d007e2d4f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:33.609143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06a9e44d-08cd-4de6-b701-591d007e2d4f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:33.609862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06a9e44d-08cd-4de6-b701-591d007e2d4f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:33.612907 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06a9e44d-08cd-4de6-b701-591d007e2d4f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:33.613688 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06a9e44d-08cd-4de6-b701-591d007e2d4f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:33.614278 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06a9e44d-08cd-4de6-b701-591d007e2d4f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:33.649527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7a9654ee-e86d-4fbc-b584-8d0dc8e5c0cb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:33.662313 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7a9654ee-e86d-4fbc-b584-8d0dc8e5c0cb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.334310 Aug 10 16:55:33.664516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 64/124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:33 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:33.904594 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-06a9e44d-08cd-4de6-b701-591d007e2d4f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:33.914761 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-06a9e44d-08cd-4de6-b701-591d007e2d4f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.341740 Aug 10 16:55:33.915881 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 61/125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:33 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:34.105490 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-f5f04dad-ccd5-40c0-8bb5-b86167f2ef58 req-b74adc93-36a4-4d75-8878-05e7bd1d28d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a08fd38-1ced-4301-a089-e789299f3104", "tag": "52b5a2cd-c933-4bfa-b4b5-c66a8d99308a"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:34.119189 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f5f04dad-ccd5-40c0-8bb5-b86167f2ef58 req-b74adc93-36a4-4d75-8878-05e7bd1d28d5 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:34.119899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f5f04dad-ccd5-40c0-8bb5-b86167f2ef58 req-b74adc93-36a4-4d75-8878-05e7bd1d28d5 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:34.120673 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f5f04dad-ccd5-40c0-8bb5-b86167f2ef58 req-b74adc93-36a4-4d75-8878-05e7bd1d28d5 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:34.138206 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-f5f04dad-ccd5-40c0-8bb5-b86167f2ef58 req-b74adc93-36a4-4d75-8878-05e7bd1d28d5 service nova] Creating event network-changed:52b5a2cd-c933-4bfa-b4b5-c66a8d99308a for instance 2a08fd38-1ced-4301-a089-e789299f3104 on hv-cinder-83602 Aug 10 16:55:34.149590 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-f5f04dad-ccd5-40c0-8bb5-b86167f2ef58 req-b74adc93-36a4-4d75-8878-05e7bd1d28d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050506 Aug 10 16:55:34.151120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 65/126] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:55:34.259278 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:34.259965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:34.267091 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:34.267581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:34.268236 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:34.269182 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:34.269933 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:34.270499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:34.347872 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-60294670-5b12-43fa-869f-387c7199bde1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:34.348607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-60294670-5b12-43fa-869f-387c7199bde1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:34.355933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60294670-5b12-43fa-869f-387c7199bde1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:34.356812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60294670-5b12-43fa-869f-387c7199bde1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:34.357478 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60294670-5b12-43fa-869f-387c7199bde1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:34.358449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60294670-5b12-43fa-869f-387c7199bde1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:34.359160 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60294670-5b12-43fa-869f-387c7199bde1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:34.359788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60294670-5b12-43fa-869f-387c7199bde1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:34.440050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:34.451578 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:34.453445 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:34.455518 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9def8a52-7a72-41a3-b18b-fd6b61e2737c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.200543 Aug 10 16:55:34.456223 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 62/127] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:34 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:34.535182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-60294670-5b12-43fa-869f-387c7199bde1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:34.540767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e414108-0dd2-4a8c-81f5-b6db138db117 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:34.541461 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e414108-0dd2-4a8c-81f5-b6db138db117 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:34.543078 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-60294670-5b12-43fa-869f-387c7199bde1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.199628 Aug 10 16:55:34.544731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 66/128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:34 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:34.547744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e414108-0dd2-4a8c-81f5-b6db138db117 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:34.548361 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e414108-0dd2-4a8c-81f5-b6db138db117 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:34.548803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e414108-0dd2-4a8c-81f5-b6db138db117 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:34.549497 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e414108-0dd2-4a8c-81f5-b6db138db117 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:34.549949 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e414108-0dd2-4a8c-81f5-b6db138db117 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:34.550374 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e414108-0dd2-4a8c-81f5-b6db138db117 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:34.683342 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d3b12100-3103-4742-b483-7ffb5faf8241 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:34.683942 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d3b12100-3103-4742-b483-7ffb5faf8241 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:34.695565 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d3b12100-3103-4742-b483-7ffb5faf8241 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:34.697084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d3b12100-3103-4742-b483-7ffb5faf8241 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:34.697774 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d3b12100-3103-4742-b483-7ffb5faf8241 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:34.699109 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d3b12100-3103-4742-b483-7ffb5faf8241 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:34.699446 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9e414108-0dd2-4a8c-81f5-b6db138db117 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:34.699795 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d3b12100-3103-4742-b483-7ffb5faf8241 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:34.700468 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d3b12100-3103-4742-b483-7ffb5faf8241 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:34.708794 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e414108-0dd2-4a8c-81f5-b6db138db117 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.171669 Aug 10 16:55:34.709641 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 63/129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:34 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:34.871126 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d3b12100-3103-4742-b483-7ffb5faf8241 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:34.879862 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d3b12100-3103-4742-b483-7ffb5faf8241 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.200901 Aug 10 16:55:34.880643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 67/130] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:34 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:34.936044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b349757e-364a-4cd9-9924-feee7867b489 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:34.936898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b349757e-364a-4cd9-9924-feee7867b489 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:34.944172 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b349757e-364a-4cd9-9924-feee7867b489 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:34.945011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b349757e-364a-4cd9-9924-feee7867b489 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:34.945632 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b349757e-364a-4cd9-9924-feee7867b489 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:34.946647 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b349757e-364a-4cd9-9924-feee7867b489 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:34.947567 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b349757e-364a-4cd9-9924-feee7867b489 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:34.948468 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b349757e-364a-4cd9-9924-feee7867b489 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:35.026045 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-0e33ce0e-8c3a-4144-8054-5f4c75877766 req-8218b6bf-03ce-4159-9ec1-f9398ce6ae2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e14798-1b43-4a9b-8ff3-70943ce0e43d", "name": "network-vif-plugged", "status": "completed", "tag": "e5aaffe6-9f88-4d4e-b636-16032e55f1d3"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:35.035946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0e33ce0e-8c3a-4144-8054-5f4c75877766 req-8218b6bf-03ce-4159-9ec1-f9398ce6ae2d service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:35.036461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0e33ce0e-8c3a-4144-8054-5f4c75877766 req-8218b6bf-03ce-4159-9ec1-f9398ce6ae2d service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:35.036883 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0e33ce0e-8c3a-4144-8054-5f4c75877766 req-8218b6bf-03ce-4159-9ec1-f9398ce6ae2d service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:35.048839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-0e33ce0e-8c3a-4144-8054-5f4c75877766 req-8218b6bf-03ce-4159-9ec1-f9398ce6ae2d service nova] Creating event network-vif-plugged:e5aaffe6-9f88-4d4e-b636-16032e55f1d3 for instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d on hv-cinder-83602 Aug 10 16:55:35.054228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-0e33ce0e-8c3a-4144-8054-5f4c75877766 req-8218b6bf-03ce-4159-9ec1-f9398ce6ae2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083798 Aug 10 16:55:35.055580 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 68/131] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:55:35.098336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b349757e-364a-4cd9-9924-feee7867b489 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:35.110291 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b349757e-364a-4cd9-9924-feee7867b489 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.178759 Aug 10 16:55:35.111439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 64/132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:34 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:35.482368 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:35.484069 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:35.499045 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:35.500719 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:35.501963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:35.505955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:35.507453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:35.509250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:35.566449 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7d676b9-e3c0-4976-9424-82cf39d1c0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:35.567052 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f7d676b9-e3c0-4976-9424-82cf39d1c0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:35.576411 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7d676b9-e3c0-4976-9424-82cf39d1c0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:35.579424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7d676b9-e3c0-4976-9424-82cf39d1c0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:35.580277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7d676b9-e3c0-4976-9424-82cf39d1c0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:35.581169 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7d676b9-e3c0-4976-9424-82cf39d1c0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:35.585473 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7d676b9-e3c0-4976-9424-82cf39d1c0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:35.586131 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7d676b9-e3c0-4976-9424-82cf39d1c0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:35.905277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f7d676b9-e3c0-4976-9424-82cf39d1c0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:35.914444 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7d676b9-e3c0-4976-9424-82cf39d1c0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.351710 Aug 10 16:55:35.915307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 65/133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:35 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:35.920085 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-76027994-4d16-4cd9-b84d-6ac38261cd4d req-ca8eb1ec-fd67-4f4a-8e50-8fc1015e762e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c45104f-0ee5-4fec-92ad-7937cbe53805", "tag": "da10f762-bc62-4992-aee6-1b182938963c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:35.929501 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76027994-4d16-4cd9-b84d-6ac38261cd4d req-ca8eb1ec-fd67-4f4a-8e50-8fc1015e762e service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:35.930041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76027994-4d16-4cd9-b84d-6ac38261cd4d req-ca8eb1ec-fd67-4f4a-8e50-8fc1015e762e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:35.930641 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76027994-4d16-4cd9-b84d-6ac38261cd4d req-ca8eb1ec-fd67-4f4a-8e50-8fc1015e762e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:35.942427 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-76027994-4d16-4cd9-b84d-6ac38261cd4d req-ca8eb1ec-fd67-4f4a-8e50-8fc1015e762e service nova] Creating event network-changed:da10f762-bc62-4992-aee6-1b182938963c for instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 on hv-cinder-83602 Aug 10 16:55:35.947512 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-76027994-4d16-4cd9-b84d-6ac38261cd4d req-ca8eb1ec-fd67-4f4a-8e50-8fc1015e762e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030900 Aug 10 16:55:35.948691 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 66/134] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:55:35.953961 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08ae353c-123e-4080-b901-fa991b3cc3c1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:35.954658 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08ae353c-123e-4080-b901-fa991b3cc3c1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:35.960975 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ae353c-123e-4080-b901-fa991b3cc3c1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:35.961461 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ae353c-123e-4080-b901-fa991b3cc3c1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:35.961893 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ae353c-123e-4080-b901-fa991b3cc3c1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:35.962585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ae353c-123e-4080-b901-fa991b3cc3c1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:35.963038 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ae353c-123e-4080-b901-fa991b3cc3c1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:35.963462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ae353c-123e-4080-b901-fa991b3cc3c1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:36.070073 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:36.083005 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:36.085923 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:36.088084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8d9ca5a0-077f-4dcc-bade-603a629980e8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.611978 Aug 10 16:55:36.089126 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 69/135] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:35 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:36.098471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-13735019-6e76-4a34-a7b4-e57d3a6baadd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:36.099354 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-13735019-6e76-4a34-a7b4-e57d3a6baadd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:36.106518 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13735019-6e76-4a34-a7b4-e57d3a6baadd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:36.107407 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13735019-6e76-4a34-a7b4-e57d3a6baadd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:36.108611 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13735019-6e76-4a34-a7b4-e57d3a6baadd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:36.109317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13735019-6e76-4a34-a7b4-e57d3a6baadd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:36.109781 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13735019-6e76-4a34-a7b4-e57d3a6baadd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:36.110182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13735019-6e76-4a34-a7b4-e57d3a6baadd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:36.184430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-08ae353c-123e-4080-b901-fa991b3cc3c1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:36.199438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08ae353c-123e-4080-b901-fa991b3cc3c1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.249262 Aug 10 16:55:36.200025 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 67/136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:35 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:36.205209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-137534b6-c7b1-4452-8993-339fa75ffe13 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:36.206325 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-137534b6-c7b1-4452-8993-339fa75ffe13 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:36.212486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137534b6-c7b1-4452-8993-339fa75ffe13 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:36.213140 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137534b6-c7b1-4452-8993-339fa75ffe13 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:36.214697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137534b6-c7b1-4452-8993-339fa75ffe13 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:36.215493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137534b6-c7b1-4452-8993-339fa75ffe13 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:36.216440 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137534b6-c7b1-4452-8993-339fa75ffe13 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:36.217070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137534b6-c7b1-4452-8993-339fa75ffe13 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:36.287711 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-13735019-6e76-4a34-a7b4-e57d3a6baadd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:36.299028 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-13735019-6e76-4a34-a7b4-e57d3a6baadd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.207935 Aug 10 16:55:36.299981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 70/137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:36 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:36.356659 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-137534b6-c7b1-4452-8993-339fa75ffe13 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:36.364011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-137534b6-c7b1-4452-8993-339fa75ffe13 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.162840 Aug 10 16:55:36.364598 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 68/138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:36 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:36.935266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ca1c9a96-6c5c-442c-848f-87d6bab42e16 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:36.935910 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ca1c9a96-6c5c-442c-848f-87d6bab42e16 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:36.941561 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1c9a96-6c5c-442c-848f-87d6bab42e16 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:36.942042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1c9a96-6c5c-442c-848f-87d6bab42e16 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:36.942471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1c9a96-6c5c-442c-848f-87d6bab42e16 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:36.943151 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1c9a96-6c5c-442c-848f-87d6bab42e16 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:36.943598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1c9a96-6c5c-442c-848f-87d6bab42e16 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:36.944014 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1c9a96-6c5c-442c-848f-87d6bab42e16 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:37.078061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ca1c9a96-6c5c-442c-848f-87d6bab42e16 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:37.086499 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ca1c9a96-6c5c-442c-848f-87d6bab42e16 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.155470 Aug 10 16:55:37.087260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 71/139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:36 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:37.113192 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:37.114196 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:37.120641 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:37.121148 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:37.121553 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:37.122241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:37.122685 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:37.123118 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:37.221808 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b47b0420-9e77-4a25-9bc5-a50e884f4f2d tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:37.222450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b47b0420-9e77-4a25-9bc5-a50e884f4f2d tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:37.229889 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b47b0420-9e77-4a25-9bc5-a50e884f4f2d tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:37.230377 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b47b0420-9e77-4a25-9bc5-a50e884f4f2d tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:37.230976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b47b0420-9e77-4a25-9bc5-a50e884f4f2d tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:37.231695 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b47b0420-9e77-4a25-9bc5-a50e884f4f2d tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:37.232156 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b47b0420-9e77-4a25-9bc5-a50e884f4f2d tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:37.232588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b47b0420-9e77-4a25-9bc5-a50e884f4f2d tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:37.274353 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:37.282923 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:37.284644 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:37.285841 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5ca85ad3-9886-4dde-a5eb-a5542672cef5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.176561 Aug 10 16:55:37.286419 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 69/140] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:37 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:37.319980 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95fc9fac-a841-41db-83f1-8aa55207e14f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:37.320713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-95fc9fac-a841-41db-83f1-8aa55207e14f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:37.326636 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95fc9fac-a841-41db-83f1-8aa55207e14f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:37.327187 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95fc9fac-a841-41db-83f1-8aa55207e14f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:37.327695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95fc9fac-a841-41db-83f1-8aa55207e14f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:37.328560 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95fc9fac-a841-41db-83f1-8aa55207e14f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:37.329103 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95fc9fac-a841-41db-83f1-8aa55207e14f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:37.329574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95fc9fac-a841-41db-83f1-8aa55207e14f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:37.334218 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:37.414987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b47b0420-9e77-4a25-9bc5-a50e884f4f2d tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:37.423933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b47b0420-9e77-4a25-9bc5-a50e884f4f2d tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.206591 Aug 10 16:55:37.425087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 72/141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:37 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:37.430252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-15fd5360-a810-46df-b87c-7b28130afdff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:37.431024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-15fd5360-a810-46df-b87c-7b28130afdff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:37.437370 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15fd5360-a810-46df-b87c-7b28130afdff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:37.437853 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15fd5360-a810-46df-b87c-7b28130afdff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:37.438279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15fd5360-a810-46df-b87c-7b28130afdff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:37.438960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15fd5360-a810-46df-b87c-7b28130afdff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:37.439765 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15fd5360-a810-46df-b87c-7b28130afdff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:37.440218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15fd5360-a810-46df-b87c-7b28130afdff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:37.489698 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-95fc9fac-a841-41db-83f1-8aa55207e14f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:37.499430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95fc9fac-a841-41db-83f1-8aa55207e14f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.183108 Aug 10 16:55:37.500246 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 70/142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:37 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:37.591197 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-15fd5360-a810-46df-b87c-7b28130afdff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:37.598858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-15fd5360-a810-46df-b87c-7b28130afdff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.172487 Aug 10 16:55:37.599585 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 73/143] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:37 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:38.109035 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8897dcbf-fc46-4bdb-9f3a-a32bd5ded365 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:38.109645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8897dcbf-fc46-4bdb-9f3a-a32bd5ded365 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:38.116263 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8897dcbf-fc46-4bdb-9f3a-a32bd5ded365 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:38.116846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8897dcbf-fc46-4bdb-9f3a-a32bd5ded365 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:38.117156 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8897dcbf-fc46-4bdb-9f3a-a32bd5ded365 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:38.117832 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8897dcbf-fc46-4bdb-9f3a-a32bd5ded365 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:38.118274 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8897dcbf-fc46-4bdb-9f3a-a32bd5ded365 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:38.118690 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8897dcbf-fc46-4bdb-9f3a-a32bd5ded365 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:38.253172 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8897dcbf-fc46-4bdb-9f3a-a32bd5ded365 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:38.260535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8897dcbf-fc46-4bdb-9f3a-a32bd5ded365 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.155299 Aug 10 16:55:38.261789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 71/144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:38 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:38.308332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:38.308938 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:38.315210 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:38.315637 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:38.316066 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:38.316774 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:38.317221 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:38.317639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:38.453489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e094009-38f3-44c2-9ee9-4986e3f1f16a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:38.453726 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e094009-38f3-44c2-9ee9-4986e3f1f16a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:38.464392 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e094009-38f3-44c2-9ee9-4986e3f1f16a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:38.465140 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e094009-38f3-44c2-9ee9-4986e3f1f16a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:38.465734 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e094009-38f3-44c2-9ee9-4986e3f1f16a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:38.466449 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e094009-38f3-44c2-9ee9-4986e3f1f16a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:38.467071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e094009-38f3-44c2-9ee9-4986e3f1f16a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:38.467758 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e094009-38f3-44c2-9ee9-4986e3f1f16a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:38.484449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:38.496772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:38.498534 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:38.499981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ee5b047f-0737-4617-a829-1f9c1e945087 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.196154 Aug 10 16:55:38.500715 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 74/145] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:38 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:38.521052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eda282d1-776a-44ad-9e6a-8f74f563551d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:38.521897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-eda282d1-776a-44ad-9e6a-8f74f563551d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:38.528492 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda282d1-776a-44ad-9e6a-8f74f563551d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:38.529303 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda282d1-776a-44ad-9e6a-8f74f563551d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:38.529887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda282d1-776a-44ad-9e6a-8f74f563551d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:38.530766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda282d1-776a-44ad-9e6a-8f74f563551d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:38.531378 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda282d1-776a-44ad-9e6a-8f74f563551d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:38.531836 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda282d1-776a-44ad-9e6a-8f74f563551d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:38.631919 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e094009-38f3-44c2-9ee9-4986e3f1f16a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:38.648331 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e094009-38f3-44c2-9ee9-4986e3f1f16a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.201571 Aug 10 16:55:38.648721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 72/146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:38 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:38.653426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce03a80f-cc15-4ecc-9e1a-12999956dd5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:38.654177 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ce03a80f-cc15-4ecc-9e1a-12999956dd5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:38.661278 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce03a80f-cc15-4ecc-9e1a-12999956dd5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:38.661778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce03a80f-cc15-4ecc-9e1a-12999956dd5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:38.662364 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce03a80f-cc15-4ecc-9e1a-12999956dd5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:38.663066 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce03a80f-cc15-4ecc-9e1a-12999956dd5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:38.663523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce03a80f-cc15-4ecc-9e1a-12999956dd5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:38.663950 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce03a80f-cc15-4ecc-9e1a-12999956dd5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:38.718223 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-eda282d1-776a-44ad-9e6a-8f74f563551d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:38.727136 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-eda282d1-776a-44ad-9e6a-8f74f563551d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.210135 Aug 10 16:55:38.728422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 75/147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:38 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:38.805191 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce03a80f-cc15-4ecc-9e1a-12999956dd5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:38.812686 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce03a80f-cc15-4ecc-9e1a-12999956dd5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.163025 Aug 10 16:55:38.813356 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 73/148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:38 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:39.282200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-019cc8b7-99f1-4ca9-903b-97b5f5715e2e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:39.282782 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-019cc8b7-99f1-4ca9-903b-97b5f5715e2e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:39.288960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-019cc8b7-99f1-4ca9-903b-97b5f5715e2e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:39.289448 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-019cc8b7-99f1-4ca9-903b-97b5f5715e2e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:39.289880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-019cc8b7-99f1-4ca9-903b-97b5f5715e2e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:39.290590 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-019cc8b7-99f1-4ca9-903b-97b5f5715e2e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:39.291019 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-019cc8b7-99f1-4ca9-903b-97b5f5715e2e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:39.291438 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-019cc8b7-99f1-4ca9-903b-97b5f5715e2e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:39.426460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-019cc8b7-99f1-4ca9-903b-97b5f5715e2e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:39.434145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-019cc8b7-99f1-4ca9-903b-97b5f5715e2e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.155809 Aug 10 16:55:39.434706 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 76/149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:39 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:39.522494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:39.523100 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:39.529816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:39.530307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:39.530752 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:39.531444 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:39.531901 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:39.532360 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:39.656848 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:39.664745 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:39.668044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:39.668044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8472f68b-2f76-4771-a413-24d8fe3b9a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.148812 Aug 10 16:55:39.668044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 74/150] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:39 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:39.678621 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8214bba1-de2e-4acb-ae08-583db8ffffbe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:39.679214 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8214bba1-de2e-4acb-ae08-583db8ffffbe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:39.685564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8214bba1-de2e-4acb-ae08-583db8ffffbe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:39.686037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8214bba1-de2e-4acb-ae08-583db8ffffbe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:39.686464 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8214bba1-de2e-4acb-ae08-583db8ffffbe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:39.687130 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8214bba1-de2e-4acb-ae08-583db8ffffbe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:39.687572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8214bba1-de2e-4acb-ae08-583db8ffffbe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:39.687984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8214bba1-de2e-4acb-ae08-583db8ffffbe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:39.751065 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1eed5c1d-bcfa-408a-8dfb-5cc847d3dd34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:39.751669 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1eed5c1d-bcfa-408a-8dfb-5cc847d3dd34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:39.757521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eed5c1d-bcfa-408a-8dfb-5cc847d3dd34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:39.758002 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eed5c1d-bcfa-408a-8dfb-5cc847d3dd34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:39.758429 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eed5c1d-bcfa-408a-8dfb-5cc847d3dd34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:39.759112 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eed5c1d-bcfa-408a-8dfb-5cc847d3dd34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:39.759559 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eed5c1d-bcfa-408a-8dfb-5cc847d3dd34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:39.759969 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eed5c1d-bcfa-408a-8dfb-5cc847d3dd34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:39.818383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8214bba1-de2e-4acb-ae08-583db8ffffbe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:39.826539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8214bba1-de2e-4acb-ae08-583db8ffffbe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.151716 Aug 10 16:55:39.827111 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 77/151] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:39 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:39.835979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3c8a99ee-bae0-48b0-bf24-7f96373210a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:39.836697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3c8a99ee-bae0-48b0-bf24-7f96373210a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:39.842531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c8a99ee-bae0-48b0-bf24-7f96373210a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:39.843047 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c8a99ee-bae0-48b0-bf24-7f96373210a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:39.843479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c8a99ee-bae0-48b0-bf24-7f96373210a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:39.844185 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c8a99ee-bae0-48b0-bf24-7f96373210a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:39.844641 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c8a99ee-bae0-48b0-bf24-7f96373210a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:39.845063 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c8a99ee-bae0-48b0-bf24-7f96373210a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:39.893873 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1eed5c1d-bcfa-408a-8dfb-5cc847d3dd34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:39.901162 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1eed5c1d-bcfa-408a-8dfb-5cc847d3dd34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.154433 Aug 10 16:55:39.901725 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 75/152] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:39 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:39.972365 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3c8a99ee-bae0-48b0-bf24-7f96373210a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:39.980197 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3c8a99ee-bae0-48b0-bf24-7f96373210a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.150617 Aug 10 16:55:39.980759 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 78/153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:39 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:40.454466 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-33161b60-312c-4234-a714-5ae8004587ab tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:40.455065 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-33161b60-312c-4234-a714-5ae8004587ab tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:40.461493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33161b60-312c-4234-a714-5ae8004587ab tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:40.461971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33161b60-312c-4234-a714-5ae8004587ab tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:40.462399 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33161b60-312c-4234-a714-5ae8004587ab tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:40.463072 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33161b60-312c-4234-a714-5ae8004587ab tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:40.464016 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33161b60-312c-4234-a714-5ae8004587ab tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:40.464465 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33161b60-312c-4234-a714-5ae8004587ab tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:40.590862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-33161b60-312c-4234-a714-5ae8004587ab tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:40.598234 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-33161b60-312c-4234-a714-5ae8004587ab tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.147568 Aug 10 16:55:40.598793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 76/154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:40 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:40.689241 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:40.689950 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:40.695821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:40.696410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:40.696915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:40.697690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:40.698728 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:40.699555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:40.721888 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:40.857363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ec410588-4731-417c-83ee-48e69735f487 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:40.861046 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ec410588-4731-417c-83ee-48e69735f487 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:40.872226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:40.874049 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec410588-4731-417c-83ee-48e69735f487 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:40.874556 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec410588-4731-417c-83ee-48e69735f487 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:40.875130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec410588-4731-417c-83ee-48e69735f487 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:40.877126 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec410588-4731-417c-83ee-48e69735f487 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:40.877806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec410588-4731-417c-83ee-48e69735f487 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:40.878410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec410588-4731-417c-83ee-48e69735f487 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:41.015645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ec410588-4731-417c-83ee-48e69735f487 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:41.022996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ec410588-4731-417c-83ee-48e69735f487 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.178673 Aug 10 16:55:41.023564 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 77/155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:40 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:41.028571 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c1e1399e-6c76-45d5-8281-4699e89a5c9c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:41.029185 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c1e1399e-6c76-45d5-8281-4699e89a5c9c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:41.034904 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1e1399e-6c76-45d5-8281-4699e89a5c9c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:41.035391 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1e1399e-6c76-45d5-8281-4699e89a5c9c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:41.035824 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1e1399e-6c76-45d5-8281-4699e89a5c9c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:41.036535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1e1399e-6c76-45d5-8281-4699e89a5c9c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:41.036987 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1e1399e-6c76-45d5-8281-4699e89a5c9c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:41.037409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1e1399e-6c76-45d5-8281-4699e89a5c9c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:41.175846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c1e1399e-6c76-45d5-8281-4699e89a5c9c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:41.176227 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:41.186746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:41.188513 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:41.189628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2fb40125-11ae-4f66-b01d-64bfd77cd446 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.504207 Aug 10 16:55:41.190354 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 79/156] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:40 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:41.195112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b50d93a5-4288-4a09-a62a-4541694857d6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:41.195868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b50d93a5-4288-4a09-a62a-4541694857d6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:41.202448 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c1e1399e-6c76-45d5-8281-4699e89a5c9c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.177830 Aug 10 16:55:41.202692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b50d93a5-4288-4a09-a62a-4541694857d6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:41.203045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 78/157] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:41 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:41.203558 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b50d93a5-4288-4a09-a62a-4541694857d6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:41.204246 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b50d93a5-4288-4a09-a62a-4541694857d6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:41.205252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b50d93a5-4288-4a09-a62a-4541694857d6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:41.205833 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b50d93a5-4288-4a09-a62a-4541694857d6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:41.206399 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b50d93a5-4288-4a09-a62a-4541694857d6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:41.353017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b50d93a5-4288-4a09-a62a-4541694857d6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:41.361186 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b50d93a5-4288-4a09-a62a-4541694857d6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.169638 Aug 10 16:55:41.361837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 80/158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:41 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:41.619663 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e521a262-5689-49ad-9508-225073cd2495 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:41.621035 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e521a262-5689-49ad-9508-225073cd2495 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:41.626936 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e521a262-5689-49ad-9508-225073cd2495 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:41.627492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e521a262-5689-49ad-9508-225073cd2495 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:41.627953 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e521a262-5689-49ad-9508-225073cd2495 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:41.628747 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e521a262-5689-49ad-9508-225073cd2495 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:41.629424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e521a262-5689-49ad-9508-225073cd2495 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:41.629916 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e521a262-5689-49ad-9508-225073cd2495 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:41.769970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e521a262-5689-49ad-9508-225073cd2495 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:41.778551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e521a262-5689-49ad-9508-225073cd2495 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.162940 Aug 10 16:55:41.779322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 79/159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:41 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:42.044123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1703dba2-70f9-4c99-bc8c-d713b5686e6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:42.044746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1703dba2-70f9-4c99-bc8c-d713b5686e6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:42.050529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1703dba2-70f9-4c99-bc8c-d713b5686e6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:42.051004 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1703dba2-70f9-4c99-bc8c-d713b5686e6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:42.051430 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1703dba2-70f9-4c99-bc8c-d713b5686e6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:42.052099 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1703dba2-70f9-4c99-bc8c-d713b5686e6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:42.052570 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1703dba2-70f9-4c99-bc8c-d713b5686e6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:42.052982 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1703dba2-70f9-4c99-bc8c-d713b5686e6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:42.177544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1703dba2-70f9-4c99-bc8c-d713b5686e6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:42.184775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1703dba2-70f9-4c99-bc8c-d713b5686e6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.145138 Aug 10 16:55:42.185334 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 81/160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:42 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:42.213333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:42.214543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:42.220624 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:42.221109 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:42.221538 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:42.222219 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:42.222531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b755118b-11ee-472a-8958-b27156ff0ca2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:42.222648 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:42.223063 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:42.223152 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b755118b-11ee-472a-8958-b27156ff0ca2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:42.229009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b755118b-11ee-472a-8958-b27156ff0ca2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:42.229501 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b755118b-11ee-472a-8958-b27156ff0ca2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:42.229957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b755118b-11ee-472a-8958-b27156ff0ca2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:42.230643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b755118b-11ee-472a-8958-b27156ff0ca2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:42.231096 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b755118b-11ee-472a-8958-b27156ff0ca2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:42.231562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b755118b-11ee-472a-8958-b27156ff0ca2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:42.352319 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:42.357248 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b755118b-11ee-472a-8958-b27156ff0ca2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:42.360460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:42.362041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:42.363141 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-99979b52-c39b-4902-92b2-930e8c6d3b38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.153704 Aug 10 16:55:42.363702 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 80/161] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:42 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:42.364580 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b755118b-11ee-472a-8958-b27156ff0ca2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.145859 Aug 10 16:55:42.365131 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 82/162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:42 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:42.382430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28828188-1494-4245-a39d-f3722c7a1df8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:42.382992 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28828188-1494-4245-a39d-f3722c7a1df8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:42.389321 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28828188-1494-4245-a39d-f3722c7a1df8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:42.389795 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28828188-1494-4245-a39d-f3722c7a1df8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:42.390222 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28828188-1494-4245-a39d-f3722c7a1df8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:42.390895 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28828188-1494-4245-a39d-f3722c7a1df8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:42.391340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28828188-1494-4245-a39d-f3722c7a1df8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:42.391757 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28828188-1494-4245-a39d-f3722c7a1df8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:42.519219 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-28828188-1494-4245-a39d-f3722c7a1df8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:42.527094 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28828188-1494-4245-a39d-f3722c7a1df8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.148289 Aug 10 16:55:42.527657 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 81/163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:42 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:42.800107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-43d05b02-0b37-4210-b7b6-33b5023c7b94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:42.800740 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-43d05b02-0b37-4210-b7b6-33b5023c7b94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:42.806694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43d05b02-0b37-4210-b7b6-33b5023c7b94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:42.807677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43d05b02-0b37-4210-b7b6-33b5023c7b94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:42.808110 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43d05b02-0b37-4210-b7b6-33b5023c7b94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:42.808808 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43d05b02-0b37-4210-b7b6-33b5023c7b94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:42.809252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43d05b02-0b37-4210-b7b6-33b5023c7b94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:42.809665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43d05b02-0b37-4210-b7b6-33b5023c7b94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:42.943869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-43d05b02-0b37-4210-b7b6-33b5023c7b94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:42.951204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-43d05b02-0b37-4210-b7b6-33b5023c7b94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.155026 Aug 10 16:55:42.951760 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 83/164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:42 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:43.204079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b09a424b-23f6-45b2-9f33-1649cbb89fce tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:43.204719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b09a424b-23f6-45b2-9f33-1649cbb89fce tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:43.210914 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09a424b-23f6-45b2-9f33-1649cbb89fce tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:43.211392 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09a424b-23f6-45b2-9f33-1649cbb89fce tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:43.211825 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09a424b-23f6-45b2-9f33-1649cbb89fce tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:43.212544 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09a424b-23f6-45b2-9f33-1649cbb89fce tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:43.212996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09a424b-23f6-45b2-9f33-1649cbb89fce tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:43.213416 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09a424b-23f6-45b2-9f33-1649cbb89fce tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:43.339422 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b09a424b-23f6-45b2-9f33-1649cbb89fce tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:43.346830 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b09a424b-23f6-45b2-9f33-1649cbb89fce tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.146569 Aug 10 16:55:43.347393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 82/165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:43 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:43.384051 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3ddea8af-63ab-4843-b5d7-95ba8b80a683 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:43.384677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3ddea8af-63ab-4843-b5d7-95ba8b80a683 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:43.385067 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:43.385833 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:43.390523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ddea8af-63ab-4843-b5d7-95ba8b80a683 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:43.391000 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ddea8af-63ab-4843-b5d7-95ba8b80a683 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:43.391422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ddea8af-63ab-4843-b5d7-95ba8b80a683 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:43.391543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:43.392027 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:43.392118 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ddea8af-63ab-4843-b5d7-95ba8b80a683 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:43.392558 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ddea8af-63ab-4843-b5d7-95ba8b80a683 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:43.392646 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:43.392971 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ddea8af-63ab-4843-b5d7-95ba8b80a683 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:43.393251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:43.393704 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:43.394131 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:43.522635 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3ddea8af-63ab-4843-b5d7-95ba8b80a683 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:43.524089 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:43.530694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3ddea8af-63ab-4843-b5d7-95ba8b80a683 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.150456 Aug 10 16:55:43.531263 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 84/166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:43 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:43.532642 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:43.534177 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:43.535279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e202c886-9802-4ed3-9fe4-6dd2db95d055 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.153830 Aug 10 16:55:43.535823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 83/167] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:43 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:43.546943 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-23d993d7-5949-4a6d-886a-8dba861cbc17 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:43.547547 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-23d993d7-5949-4a6d-886a-8dba861cbc17 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:43.553333 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-23d993d7-5949-4a6d-886a-8dba861cbc17 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:43.554053 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-23d993d7-5949-4a6d-886a-8dba861cbc17 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:43.554498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-23d993d7-5949-4a6d-886a-8dba861cbc17 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:43.555177 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-23d993d7-5949-4a6d-886a-8dba861cbc17 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:43.555631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-23d993d7-5949-4a6d-886a-8dba861cbc17 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:43.556050 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-23d993d7-5949-4a6d-886a-8dba861cbc17 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:43.686315 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-23d993d7-5949-4a6d-886a-8dba861cbc17 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:43.693798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-23d993d7-5949-4a6d-886a-8dba861cbc17 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.150483 Aug 10 16:55:43.694517 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 85/168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:43 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:43.971268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b37fae40-e08d-45db-806a-6805bbcaba1e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:43.971881 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b37fae40-e08d-45db-806a-6805bbcaba1e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:43.977729 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b37fae40-e08d-45db-806a-6805bbcaba1e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:43.978220 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b37fae40-e08d-45db-806a-6805bbcaba1e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:43.978657 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b37fae40-e08d-45db-806a-6805bbcaba1e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:43.979341 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b37fae40-e08d-45db-806a-6805bbcaba1e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:43.979793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b37fae40-e08d-45db-806a-6805bbcaba1e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:43.980249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b37fae40-e08d-45db-806a-6805bbcaba1e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:44.105588 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b37fae40-e08d-45db-806a-6805bbcaba1e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:44.112917 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b37fae40-e08d-45db-806a-6805bbcaba1e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.145414 Aug 10 16:55:44.113477 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 84/169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:43 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:44.368613 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-377536b0-04df-4d9b-9114-a995d930bc03 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:44.369138 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-377536b0-04df-4d9b-9114-a995d930bc03 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:44.372576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:44.376699 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-377536b0-04df-4d9b-9114-a995d930bc03 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:44.377182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-377536b0-04df-4d9b-9114-a995d930bc03 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:44.377617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-377536b0-04df-4d9b-9114-a995d930bc03 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:44.378300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-377536b0-04df-4d9b-9114-a995d930bc03 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:44.378750 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-377536b0-04df-4d9b-9114-a995d930bc03 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:44.379175 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-377536b0-04df-4d9b-9114-a995d930bc03 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:44.503629 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-377536b0-04df-4d9b-9114-a995d930bc03 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:44.510932 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-377536b0-04df-4d9b-9114-a995d930bc03 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.146274 Aug 10 16:55:44.511512 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 86/170] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:44 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:44.552965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6de21733-e035-4570-b0e0-7a0509579c55 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:44.553561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6de21733-e035-4570-b0e0-7a0509579c55 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:44.558163 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:44.558770 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:44.560227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6de21733-e035-4570-b0e0-7a0509579c55 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:44.560716 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6de21733-e035-4570-b0e0-7a0509579c55 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:44.561150 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6de21733-e035-4570-b0e0-7a0509579c55 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:44.561831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6de21733-e035-4570-b0e0-7a0509579c55 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:44.562275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6de21733-e035-4570-b0e0-7a0509579c55 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:44.562692 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6de21733-e035-4570-b0e0-7a0509579c55 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:44.564606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:44.565087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:44.565543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:44.566229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:44.566682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:44.567097 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:44.693241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6de21733-e035-4570-b0e0-7a0509579c55 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:44.693411 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:44.700724 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6de21733-e035-4570-b0e0-7a0509579c55 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.151545 Aug 10 16:55:44.701299 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 85/171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:44 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:44.701518 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:44.703095 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:44.704301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f10b10a1-aad0-4d33-af5a-f4b3527931b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.150492 Aug 10 16:55:44.704962 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 87/172] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:44 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:44.714543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d2553224-8a9b-400b-b2b7-92dfc52f19bc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:44.715305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d2553224-8a9b-400b-b2b7-92dfc52f19bc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:44.721411 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2553224-8a9b-400b-b2b7-92dfc52f19bc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:44.721972 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2553224-8a9b-400b-b2b7-92dfc52f19bc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:44.722476 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2553224-8a9b-400b-b2b7-92dfc52f19bc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:44.723249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2553224-8a9b-400b-b2b7-92dfc52f19bc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:44.723770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2553224-8a9b-400b-b2b7-92dfc52f19bc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:44.724302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2553224-8a9b-400b-b2b7-92dfc52f19bc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:44.856842 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d2553224-8a9b-400b-b2b7-92dfc52f19bc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:44.860296 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:44.864868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d2553224-8a9b-400b-b2b7-92dfc52f19bc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.154075 Aug 10 16:55:44.865431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 86/173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:44 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:45.133787 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-694bbf2b-ad2f-4815-a88d-4fb284d04502 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:45.134395 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-694bbf2b-ad2f-4815-a88d-4fb284d04502 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:45.140658 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-694bbf2b-ad2f-4815-a88d-4fb284d04502 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:45.141133 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-694bbf2b-ad2f-4815-a88d-4fb284d04502 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:45.141564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-694bbf2b-ad2f-4815-a88d-4fb284d04502 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:45.142264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-694bbf2b-ad2f-4815-a88d-4fb284d04502 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:45.142714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-694bbf2b-ad2f-4815-a88d-4fb284d04502 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:45.143132 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-694bbf2b-ad2f-4815-a88d-4fb284d04502 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:45.271907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-694bbf2b-ad2f-4815-a88d-4fb284d04502 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:45.280757 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-694bbf2b-ad2f-4815-a88d-4fb284d04502 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.150689 Aug 10 16:55:45.281436 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 88/174] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:45 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:45.531822 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0d01c4d-0d18-46e1-9117-e17789dd8f27 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:45.532388 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b0d01c4d-0d18-46e1-9117-e17789dd8f27 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:45.538261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0d01c4d-0d18-46e1-9117-e17789dd8f27 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:45.538735 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0d01c4d-0d18-46e1-9117-e17789dd8f27 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:45.539159 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0d01c4d-0d18-46e1-9117-e17789dd8f27 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:45.539828 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0d01c4d-0d18-46e1-9117-e17789dd8f27 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:45.540303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0d01c4d-0d18-46e1-9117-e17789dd8f27 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:45.540719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0d01c4d-0d18-46e1-9117-e17789dd8f27 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:45.666640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0d01c4d-0d18-46e1-9117-e17789dd8f27 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:45.673954 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0d01c4d-0d18-46e1-9117-e17789dd8f27 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.146472 Aug 10 16:55:45.674522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 87/175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:45 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:45.721527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d097fbca-bc54-40c7-a4db-b1ed9f53ae71 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:45.722127 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d097fbca-bc54-40c7-a4db-b1ed9f53ae71 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:45.726549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:45.727285 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:45.727965 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d097fbca-bc54-40c7-a4db-b1ed9f53ae71 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:45.728474 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d097fbca-bc54-40c7-a4db-b1ed9f53ae71 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:45.728903 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d097fbca-bc54-40c7-a4db-b1ed9f53ae71 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:45.729576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d097fbca-bc54-40c7-a4db-b1ed9f53ae71 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:45.730019 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d097fbca-bc54-40c7-a4db-b1ed9f53ae71 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:45.730606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d097fbca-bc54-40c7-a4db-b1ed9f53ae71 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:45.733257 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:45.733734 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:45.734161 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:45.734834 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:45.735279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:45.735691 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:45.877046 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d097fbca-bc54-40c7-a4db-b1ed9f53ae71 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:45.891257 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:45.896697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d097fbca-bc54-40c7-a4db-b1ed9f53ae71 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.178940 Aug 10 16:55:45.900281 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:45.902133 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:45.902741 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 89/176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:45 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:45.903401 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dbe52765-5aa8-481d-92d0-dacbead501d8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.180553 Aug 10 16:55:45.916168 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 88/177] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:45 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:45.922072 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bfb5dcde-192f-4a42-ac13-9b1db8edff81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:45.922684 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bfb5dcde-192f-4a42-ac13-9b1db8edff81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:45.935324 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcde-192f-4a42-ac13-9b1db8edff81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:45.935813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcde-192f-4a42-ac13-9b1db8edff81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:45.936292 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcde-192f-4a42-ac13-9b1db8edff81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:45.937700 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcde-192f-4a42-ac13-9b1db8edff81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:45.938487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcde-192f-4a42-ac13-9b1db8edff81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:45.939871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcde-192f-4a42-ac13-9b1db8edff81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:46.030976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-df7a9dbc-f518-4deb-8162-5703de820323 req-43dcb737-88ac-4edf-8638-6df2b148bf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8017eb-1d19-483c-b2ee-e5d8b07b16e9", "name": "network-vif-plugged", "status": "completed", "tag": "a1ea9959-841c-429c-a71e-74b97583bc3f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:46.043067 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-df7a9dbc-f518-4deb-8162-5703de820323 req-43dcb737-88ac-4edf-8638-6df2b148bf2b service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:46.043812 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-df7a9dbc-f518-4deb-8162-5703de820323 req-43dcb737-88ac-4edf-8638-6df2b148bf2b service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:46.044512 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-df7a9dbc-f518-4deb-8162-5703de820323 req-43dcb737-88ac-4edf-8638-6df2b148bf2b service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:46.059960 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-df7a9dbc-f518-4deb-8162-5703de820323 req-43dcb737-88ac-4edf-8638-6df2b148bf2b service nova] Creating event network-vif-plugged:a1ea9959-841c-429c-a71e-74b97583bc3f for instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 on hv-cinder-83602 Aug 10 16:55:46.065393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-df7a9dbc-f518-4deb-8162-5703de820323 req-43dcb737-88ac-4edf-8638-6df2b148bf2b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038372 Aug 10 16:55:46.066721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 89/178] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:55:46.081410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bfb5dcde-192f-4a42-ac13-9b1db8edff81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:46.089497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bfb5dcde-192f-4a42-ac13-9b1db8edff81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.185360 Aug 10 16:55:46.090066 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 90/179] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:45 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:46.302141 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f62ffa49-a164-48ed-b2dd-fb2f6cf8cf57 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:46.302825 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f62ffa49-a164-48ed-b2dd-fb2f6cf8cf57 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:46.308899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f62ffa49-a164-48ed-b2dd-fb2f6cf8cf57 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:46.309377 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f62ffa49-a164-48ed-b2dd-fb2f6cf8cf57 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:46.309810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f62ffa49-a164-48ed-b2dd-fb2f6cf8cf57 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:46.310539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f62ffa49-a164-48ed-b2dd-fb2f6cf8cf57 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:46.310937 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f62ffa49-a164-48ed-b2dd-fb2f6cf8cf57 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:46.311355 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f62ffa49-a164-48ed-b2dd-fb2f6cf8cf57 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:46.436980 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f62ffa49-a164-48ed-b2dd-fb2f6cf8cf57 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:46.444374 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f62ffa49-a164-48ed-b2dd-fb2f6cf8cf57 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.146482 Aug 10 16:55:46.444938 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 90/180] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:46 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:46.701028 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d028540e-653f-42dd-bc69-612ed0d5e3a3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:46.701637 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d028540e-653f-42dd-bc69-612ed0d5e3a3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:46.708112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d028540e-653f-42dd-bc69-612ed0d5e3a3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:46.708622 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d028540e-653f-42dd-bc69-612ed0d5e3a3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:46.709081 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d028540e-653f-42dd-bc69-612ed0d5e3a3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:46.709802 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d028540e-653f-42dd-bc69-612ed0d5e3a3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:46.710279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d028540e-653f-42dd-bc69-612ed0d5e3a3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:46.710729 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d028540e-653f-42dd-bc69-612ed0d5e3a3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:46.835587 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d028540e-653f-42dd-bc69-612ed0d5e3a3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:46.843420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d028540e-653f-42dd-bc69-612ed0d5e3a3 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.146732 Aug 10 16:55:46.843988 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 91/181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:46 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:46.922689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-25f6d5a5-75e6-4266-9860-6dc4fcfc73ae tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:46.923301 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-25f6d5a5-75e6-4266-9860-6dc4fcfc73ae tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:46.929788 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25f6d5a5-75e6-4266-9860-6dc4fcfc73ae tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:46.930282 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25f6d5a5-75e6-4266-9860-6dc4fcfc73ae tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:46.931208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25f6d5a5-75e6-4266-9860-6dc4fcfc73ae tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:46.931915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25f6d5a5-75e6-4266-9860-6dc4fcfc73ae tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:46.932529 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25f6d5a5-75e6-4266-9860-6dc4fcfc73ae tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:46.932957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25f6d5a5-75e6-4266-9860-6dc4fcfc73ae tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:46.935052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:46.936109 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:46.942858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:46.943347 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:46.943931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:46.944654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:46.945101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:46.945519 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:47.107695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-25f6d5a5-75e6-4266-9860-6dc4fcfc73ae tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:47.117092 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-25f6d5a5-75e6-4266-9860-6dc4fcfc73ae tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.198180 Aug 10 16:55:47.117412 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:47.117880 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 91/182] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:46 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:47.123968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b204cd73-fbc2-4750-8cd9-bdf428b44ada tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:47.124579 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b204cd73-fbc2-4750-8cd9-bdf428b44ada tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:47.126931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:47.128588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:47.129922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-49d583e9-270e-4d17-ad3d-d1319e366b71 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.199384 Aug 10 16:55:47.130439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b204cd73-fbc2-4750-8cd9-bdf428b44ada tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:47.131080 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b204cd73-fbc2-4750-8cd9-bdf428b44ada tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:47.131506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b204cd73-fbc2-4750-8cd9-bdf428b44ada tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:47.132448 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b204cd73-fbc2-4750-8cd9-bdf428b44ada tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:47.133140 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b204cd73-fbc2-4750-8cd9-bdf428b44ada tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:47.133745 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b204cd73-fbc2-4750-8cd9-bdf428b44ada tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:47.136609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 92/183] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:46 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:47.270247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b204cd73-fbc2-4750-8cd9-bdf428b44ada tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:47.277514 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b204cd73-fbc2-4750-8cd9-bdf428b44ada tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.158581 Aug 10 16:55:47.278081 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 92/184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:47 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:47.466031 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e59b9354-9f3e-4230-a2c8-cf0df337a288 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:47.466638 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e59b9354-9f3e-4230-a2c8-cf0df337a288 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:47.472484 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e59b9354-9f3e-4230-a2c8-cf0df337a288 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:47.472897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e59b9354-9f3e-4230-a2c8-cf0df337a288 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:47.473324 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e59b9354-9f3e-4230-a2c8-cf0df337a288 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:47.474002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e59b9354-9f3e-4230-a2c8-cf0df337a288 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:47.474443 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e59b9354-9f3e-4230-a2c8-cf0df337a288 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:47.474856 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e59b9354-9f3e-4230-a2c8-cf0df337a288 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:47.607270 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e59b9354-9f3e-4230-a2c8-cf0df337a288 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:47.614614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e59b9354-9f3e-4230-a2c8-cf0df337a288 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.152429 Aug 10 16:55:47.615167 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 93/185] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:47 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:47.864032 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8bee6159-4c07-4de3-aedc-977f5d33e397 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:47.864587 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8bee6159-4c07-4de3-aedc-977f5d33e397 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:47.871703 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee6159-4c07-4de3-aedc-977f5d33e397 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:47.872378 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee6159-4c07-4de3-aedc-977f5d33e397 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:47.872846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee6159-4c07-4de3-aedc-977f5d33e397 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:47.879382 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee6159-4c07-4de3-aedc-977f5d33e397 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:47.879907 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee6159-4c07-4de3-aedc-977f5d33e397 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:47.880368 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee6159-4c07-4de3-aedc-977f5d33e397 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:48.022356 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8bee6159-4c07-4de3-aedc-977f5d33e397 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:48.030499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8bee6159-4c07-4de3-aedc-977f5d33e397 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1314 microversion: 2.1 time: 0.170335 Aug 10 16:55:48.031141 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 93/186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:47 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:48.139863 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-af10f350-9254-4c10-9e66-9078a0fe8dcb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:48.141345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-af10f350-9254-4c10-9e66-9078a0fe8dcb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:48.153500 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:48.154238 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:48.160630 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10f350-9254-4c10-9e66-9078a0fe8dcb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:48.160930 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10f350-9254-4c10-9e66-9078a0fe8dcb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:48.161369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10f350-9254-4c10-9e66-9078a0fe8dcb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:48.163624 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:48.164109 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:48.164569 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:48.165263 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:48.165715 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:48.166140 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:48.167850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10f350-9254-4c10-9e66-9078a0fe8dcb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:48.168383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10f350-9254-4c10-9e66-9078a0fe8dcb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:48.168876 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af10f350-9254-4c10-9e66-9078a0fe8dcb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:48.347763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:48.349371 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-af10f350-9254-4c10-9e66-9078a0fe8dcb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:48.357712 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:48.357870 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-af10f350-9254-4c10-9e66-9078a0fe8dcb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.222646 Aug 10 16:55:48.358886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 94/187] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:48 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:48.364691 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-72f1c5db-ae52-42e3-a84d-1ec4d683b4a7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:48.365516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-72f1c5db-ae52-42e3-a84d-1ec4d683b4a7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:48.372712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72f1c5db-ae52-42e3-a84d-1ec4d683b4a7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:48.373438 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72f1c5db-ae52-42e3-a84d-1ec4d683b4a7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:48.374092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72f1c5db-ae52-42e3-a84d-1ec4d683b4a7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:48.375147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72f1c5db-ae52-42e3-a84d-1ec4d683b4a7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:48.375864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72f1c5db-ae52-42e3-a84d-1ec4d683b4a7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:48.376402 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72f1c5db-ae52-42e3-a84d-1ec4d683b4a7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:48.384348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:48.386590 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-97e4fe38-0184-4bb4-a3f2-34bc69318337 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.237451 Aug 10 16:55:48.387682 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 94/188] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:48 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:48.555859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-72f1c5db-ae52-42e3-a84d-1ec4d683b4a7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:48.566724 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-72f1c5db-ae52-42e3-a84d-1ec4d683b4a7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.206158 Aug 10 16:55:48.567342 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 95/189] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:48 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:48.636451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5133c119-bd9a-471a-a1bd-9e360c29303d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:48.637152 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5133c119-bd9a-471a-a1bd-9e360c29303d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:48.647307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5133c119-bd9a-471a-a1bd-9e360c29303d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:48.648070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5133c119-bd9a-471a-a1bd-9e360c29303d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:48.648730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5133c119-bd9a-471a-a1bd-9e360c29303d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:48.649477 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5133c119-bd9a-471a-a1bd-9e360c29303d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:48.650021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5133c119-bd9a-471a-a1bd-9e360c29303d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:48.650541 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5133c119-bd9a-471a-a1bd-9e360c29303d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:48.802040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5133c119-bd9a-471a-a1bd-9e360c29303d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:48.810613 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5133c119-bd9a-471a-a1bd-9e360c29303d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.179603 Aug 10 16:55:48.824903 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 95/190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:48 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:49.052252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-571b1c24-414f-4dd6-bc51-694119027b31 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:49.052843 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-571b1c24-414f-4dd6-bc51-694119027b31 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:49.059435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-571b1c24-414f-4dd6-bc51-694119027b31 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:49.059914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-571b1c24-414f-4dd6-bc51-694119027b31 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:49.060369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-571b1c24-414f-4dd6-bc51-694119027b31 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:49.061047 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-571b1c24-414f-4dd6-bc51-694119027b31 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:49.061492 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-571b1c24-414f-4dd6-bc51-694119027b31 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:49.061910 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-571b1c24-414f-4dd6-bc51-694119027b31 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:49.065807 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:49.187735 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-571b1c24-414f-4dd6-bc51-694119027b31 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:49.195097 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-571b1c24-414f-4dd6-bc51-694119027b31 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1501 microversion: 2.1 time: 0.146758 Aug 10 16:55:49.195657 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 96/191] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:49 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1501 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:49.378515 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c989880b-def0-40ae-b7ab-3e689c0fe72a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:49.380376 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c989880b-def0-40ae-b7ab-3e689c0fe72a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:49.387658 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c989880b-def0-40ae-b7ab-3e689c0fe72a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:49.388376 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c989880b-def0-40ae-b7ab-3e689c0fe72a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:49.388989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c989880b-def0-40ae-b7ab-3e689c0fe72a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:49.390270 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c989880b-def0-40ae-b7ab-3e689c0fe72a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:49.391353 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c989880b-def0-40ae-b7ab-3e689c0fe72a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:49.392021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c989880b-def0-40ae-b7ab-3e689c0fe72a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:49.411486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:49.412374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:49.423852 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:49.425714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:49.427432 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:49.429324 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:49.432925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:49.434704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:49.643858 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c989880b-def0-40ae-b7ab-3e689c0fe72a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:49.656569 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c989880b-def0-40ae-b7ab-3e689c0fe72a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.281977 Aug 10 16:55:49.657565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 96/192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:49 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:49.662531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-70bd4129-2f92-4bd5-a95c-566d4d4b7310 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:49.663282 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-70bd4129-2f92-4bd5-a95c-566d4d4b7310 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:49.689587 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70bd4129-2f92-4bd5-a95c-566d4d4b7310 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:49.690103 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70bd4129-2f92-4bd5-a95c-566d4d4b7310 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:49.690525 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70bd4129-2f92-4bd5-a95c-566d4d4b7310 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:49.691269 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70bd4129-2f92-4bd5-a95c-566d4d4b7310 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:49.694190 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70bd4129-2f92-4bd5-a95c-566d4d4b7310 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:49.694634 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70bd4129-2f92-4bd5-a95c-566d4d4b7310 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:49.696040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:49.714333 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:49.719572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:49.721138 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5a7a9148-dffa-4c37-8f2b-dfa64364dd19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.314213 Aug 10 16:55:49.726841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 97/193] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:49 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:49.834313 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-530cbaf2-9b6a-4bcb-9e78-45b5cef45399 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:49.834948 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-530cbaf2-9b6a-4bcb-9e78-45b5cef45399 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:49.842869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-530cbaf2-9b6a-4bcb-9e78-45b5cef45399 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:49.843350 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-530cbaf2-9b6a-4bcb-9e78-45b5cef45399 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:49.843773 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-530cbaf2-9b6a-4bcb-9e78-45b5cef45399 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:49.844487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-530cbaf2-9b6a-4bcb-9e78-45b5cef45399 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:49.844932 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-530cbaf2-9b6a-4bcb-9e78-45b5cef45399 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:49.845344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-530cbaf2-9b6a-4bcb-9e78-45b5cef45399 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:49.861840 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-70bd4129-2f92-4bd5-a95c-566d4d4b7310 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:49.872426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-70bd4129-2f92-4bd5-a95c-566d4d4b7310 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.212135 Aug 10 16:55:49.873268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 97/194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:49 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:50.017473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-530cbaf2-9b6a-4bcb-9e78-45b5cef45399 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:50.027619 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-530cbaf2-9b6a-4bcb-9e78-45b5cef45399 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.198543 Aug 10 16:55:50.028859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 98/195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:49 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:50.625105 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86b3f8bd-6b41-422f-9897-33f285bd8e0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a2fa99b-49b8-46af-a564-45e038b73271"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:50.626632 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-86b3f8bd-6b41-422f-9897-33f285bd8e0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:50.632820 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b3f8bd-6b41-422f-9897-33f285bd8e0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:50.633319 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b3f8bd-6b41-422f-9897-33f285bd8e0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:50.634077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b3f8bd-6b41-422f-9897-33f285bd8e0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:50.634727 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b3f8bd-6b41-422f-9897-33f285bd8e0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:50.635212 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b3f8bd-6b41-422f-9897-33f285bd8e0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:50.635656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b3f8bd-6b41-422f-9897-33f285bd8e0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:50.678791 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f8acaac1-16cd-441a-bab2-66296295a504 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:50.679392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f8acaac1-16cd-441a-bab2-66296295a504 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:50.685824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8acaac1-16cd-441a-bab2-66296295a504 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:50.686298 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8acaac1-16cd-441a-bab2-66296295a504 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:50.686726 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8acaac1-16cd-441a-bab2-66296295a504 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:50.687398 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8acaac1-16cd-441a-bab2-66296295a504 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:50.687843 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8acaac1-16cd-441a-bab2-66296295a504 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:50.688302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8acaac1-16cd-441a-bab2-66296295a504 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:50.826719 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f8acaac1-16cd-441a-bab2-66296295a504 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:50.834273 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f8acaac1-16cd-441a-bab2-66296295a504 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.159318 Aug 10 16:55:50.834833 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 99/196] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:50 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:50.839899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:50.840709 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:50.846511 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:50.846994 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:50.847423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:50.848191 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:50.848671 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:50.849091 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:50.986911 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:50.999369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:51.000899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:51.002003 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ca22c6ec-69cc-4948-a90b-8701bbff2d4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.166159 Aug 10 16:55:51.002559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 100/197] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:50 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:51.007284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-793b7aee-4c30-47dc-979f-191e74a10077 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:51.007910 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-793b7aee-4c30-47dc-979f-191e74a10077 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:51.015312 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-793b7aee-4c30-47dc-979f-191e74a10077 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:51.016574 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-793b7aee-4c30-47dc-979f-191e74a10077 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:51.017099 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-793b7aee-4c30-47dc-979f-191e74a10077 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:51.017903 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-793b7aee-4c30-47dc-979f-191e74a10077 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:51.018539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-793b7aee-4c30-47dc-979f-191e74a10077 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:51.019424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-793b7aee-4c30-47dc-979f-191e74a10077 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:51.160440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-793b7aee-4c30-47dc-979f-191e74a10077 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:51.169327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-793b7aee-4c30-47dc-979f-191e74a10077 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.165387 Aug 10 16:55:51.169903 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 101/198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:51 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:51.174897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-39d4d662-71d1-4570-b001-67397c1bfbfe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:51.175486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-39d4d662-71d1-4570-b001-67397c1bfbfe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:51.182628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39d4d662-71d1-4570-b001-67397c1bfbfe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:51.183287 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39d4d662-71d1-4570-b001-67397c1bfbfe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:51.183882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39d4d662-71d1-4570-b001-67397c1bfbfe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:51.184814 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39d4d662-71d1-4570-b001-67397c1bfbfe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:51.185401 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39d4d662-71d1-4570-b001-67397c1bfbfe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:51.185968 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39d4d662-71d1-4570-b001-67397c1bfbfe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:51.496091 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-39d4d662-71d1-4570-b001-67397c1bfbfe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:51.508495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-39d4d662-71d1-4570-b001-67397c1bfbfe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.337340 Aug 10 16:55:51.511156 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 102/199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:51 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:51.514496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86b3f8bd-6b41-422f-9897-33f285bd8e0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "POST /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.894099 Aug 10 16:55:51.515729 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 98/200] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 16:55:50 2022] POST /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d/os-volume_attachments => generated 194 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:55:51.598257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-1e901ba0-174f-42d8-8128-d21ae308caa9 req-eac87ca3-fd28-4a49-92d2-98c6a34065d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47c5a69-d424-4029-aa71-d2a0375d20cf", "name": "network-vif-plugged", "status": "completed", "tag": "df7c9811-d38c-42e7-af16-56a3efaa2ab9"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:55:51.609869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-1e901ba0-174f-42d8-8128-d21ae308caa9 req-eac87ca3-fd28-4a49-92d2-98c6a34065d4 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:51.610358 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-1e901ba0-174f-42d8-8128-d21ae308caa9 req-eac87ca3-fd28-4a49-92d2-98c6a34065d4 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:51.610788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-1e901ba0-174f-42d8-8128-d21ae308caa9 req-eac87ca3-fd28-4a49-92d2-98c6a34065d4 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:51.621716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-1e901ba0-174f-42d8-8128-d21ae308caa9 req-eac87ca3-fd28-4a49-92d2-98c6a34065d4 service nova] Creating event network-vif-plugged:df7c9811-d38c-42e7-af16-56a3efaa2ab9 for instance a47c5a69-d424-4029-aa71-d2a0375d20cf on hv-cinder-83602 Aug 10 16:55:51.626874 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-1e901ba0-174f-42d8-8128-d21ae308caa9 req-eac87ca3-fd28-4a49-92d2-98c6a34065d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032488 Aug 10 16:55:51.628052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 103/201] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:55:51.856453 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0e8e6d3e-c61a-485f-9e0f-5db504cb093c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:51.857237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0e8e6d3e-c61a-485f-9e0f-5db504cb093c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:51.863812 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8e6d3e-c61a-485f-9e0f-5db504cb093c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:51.864409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8e6d3e-c61a-485f-9e0f-5db504cb093c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:51.864919 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8e6d3e-c61a-485f-9e0f-5db504cb093c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:51.865617 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8e6d3e-c61a-485f-9e0f-5db504cb093c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:51.866071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8e6d3e-c61a-485f-9e0f-5db504cb093c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:51.866499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8e6d3e-c61a-485f-9e0f-5db504cb093c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:52.009816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0e8e6d3e-c61a-485f-9e0f-5db504cb093c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:52.021034 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0e8e6d3e-c61a-485f-9e0f-5db504cb093c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.169373 Aug 10 16:55:52.022001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 99/202] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:51 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:52.025588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:52.026880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:52.032986 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:52.033463 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:52.033896 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:52.034573 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:52.035020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:52.035433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:52.165473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:52.173776 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:52.175197 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:52.176354 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-341c0e15-875b-49df-8345-f31a268d8230 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.154992 Aug 10 16:55:52.176966 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 104/203] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:52 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:55:52.192657 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3249faf7-9aef-45fd-ba08-77054b270534 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:52.193264 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3249faf7-9aef-45fd-ba08-77054b270534 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:52.199984 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3249faf7-9aef-45fd-ba08-77054b270534 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:52.200497 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3249faf7-9aef-45fd-ba08-77054b270534 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:52.200932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3249faf7-9aef-45fd-ba08-77054b270534 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:52.201661 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3249faf7-9aef-45fd-ba08-77054b270534 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:52.202115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3249faf7-9aef-45fd-ba08-77054b270534 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:52.202535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3249faf7-9aef-45fd-ba08-77054b270534 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:52.336066 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-3249faf7-9aef-45fd-ba08-77054b270534 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:52.344039 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3249faf7-9aef-45fd-ba08-77054b270534 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.155224 Aug 10 16:55:52.344644 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 100/204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:52 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:52.539544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c1ecc9c4-2442-42c8-82be-ffd229c1ddd1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:52.540056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c1ecc9c4-2442-42c8-82be-ffd229c1ddd1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:52.546766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1ecc9c4-2442-42c8-82be-ffd229c1ddd1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:52.547247 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1ecc9c4-2442-42c8-82be-ffd229c1ddd1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:52.547675 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1ecc9c4-2442-42c8-82be-ffd229c1ddd1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:52.548412 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1ecc9c4-2442-42c8-82be-ffd229c1ddd1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:52.548863 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1ecc9c4-2442-42c8-82be-ffd229c1ddd1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:52.549282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1ecc9c4-2442-42c8-82be-ffd229c1ddd1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:52.680420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c1ecc9c4-2442-42c8-82be-ffd229c1ddd1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:52.688570 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c1ecc9c4-2442-42c8-82be-ffd229c1ddd1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.152942 Aug 10 16:55:52.689151 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 105/205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:52 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:53.043277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2428ae3-bcbb-4bc4-9663-969268db989a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:53.043857 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2428ae3-bcbb-4bc4-9663-969268db989a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:53.050178 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2428ae3-bcbb-4bc4-9663-969268db989a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:53.050652 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2428ae3-bcbb-4bc4-9663-969268db989a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:53.051077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2428ae3-bcbb-4bc4-9663-969268db989a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:53.051753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2428ae3-bcbb-4bc4-9663-969268db989a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:53.052224 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2428ae3-bcbb-4bc4-9663-969268db989a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:53.052642 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2428ae3-bcbb-4bc4-9663-969268db989a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:53.175324 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2428ae3-bcbb-4bc4-9663-969268db989a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:53.183078 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2428ae3-bcbb-4bc4-9663-969268db989a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.144150 Aug 10 16:55:53.183476 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 101/206] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:53 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:53.198320 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:53.198921 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:53.204691 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:53.205366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:53.205799 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:53.206480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:53.206956 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:53.207640 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:53.337600 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:53.345929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:53.347435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:53.348562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-282e5422-60cd-4da7-acca-948ad5b63d55 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.154073 Aug 10 16:55:53.349125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 106/207] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:53 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:53.366763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7b862f7-0fe4-4264-a2f3-d1fde6e6a098 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:53.367386 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a7b862f7-0fe4-4264-a2f3-d1fde6e6a098 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:53.373273 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7b862f7-0fe4-4264-a2f3-d1fde6e6a098 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:53.373746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7b862f7-0fe4-4264-a2f3-d1fde6e6a098 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:53.374178 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7b862f7-0fe4-4264-a2f3-d1fde6e6a098 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:53.374854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7b862f7-0fe4-4264-a2f3-d1fde6e6a098 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:53.375300 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7b862f7-0fe4-4264-a2f3-d1fde6e6a098 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:53.375716 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7b862f7-0fe4-4264-a2f3-d1fde6e6a098 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:53.501054 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a7b862f7-0fe4-4264-a2f3-d1fde6e6a098 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:53.504588 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:53.509431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7b862f7-0fe4-4264-a2f3-d1fde6e6a098 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.146171 Aug 10 16:55:53.510481 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 102/208] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:53 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:53.714773 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3f007568-65d9-435a-829b-0dc80513bfb9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:53.715317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3f007568-65d9-435a-829b-0dc80513bfb9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:53.721202 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f007568-65d9-435a-829b-0dc80513bfb9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:53.721680 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f007568-65d9-435a-829b-0dc80513bfb9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:53.722110 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f007568-65d9-435a-829b-0dc80513bfb9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:53.722826 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f007568-65d9-435a-829b-0dc80513bfb9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:53.723272 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f007568-65d9-435a-829b-0dc80513bfb9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:53.723690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f007568-65d9-435a-829b-0dc80513bfb9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:53.848068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3f007568-65d9-435a-829b-0dc80513bfb9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:53.855340 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3f007568-65d9-435a-829b-0dc80513bfb9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.145046 Aug 10 16:55:53.855907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 107/209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:53 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:54.203071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6e0abdaa-c14e-453d-ba63-3ccc2bd9105b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:54.203679 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6e0abdaa-c14e-453d-ba63-3ccc2bd9105b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:54.210838 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0abdaa-c14e-453d-ba63-3ccc2bd9105b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:54.211327 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0abdaa-c14e-453d-ba63-3ccc2bd9105b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:54.211760 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0abdaa-c14e-453d-ba63-3ccc2bd9105b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:54.212490 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0abdaa-c14e-453d-ba63-3ccc2bd9105b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:54.212939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0abdaa-c14e-453d-ba63-3ccc2bd9105b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:54.213361 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0abdaa-c14e-453d-ba63-3ccc2bd9105b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:54.342734 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6e0abdaa-c14e-453d-ba63-3ccc2bd9105b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:54.350028 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6e0abdaa-c14e-453d-ba63-3ccc2bd9105b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.151063 Aug 10 16:55:54.350585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 103/210] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:54 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:54.371295 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:54.371904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:54.377786 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:54.378264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:54.378696 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:54.379378 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:54.379828 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:54.380281 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:54.507170 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:54.514926 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:54.516455 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:54.517637 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8cffad8b-9276-49cf-b73a-832e40a2d35e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.150862 Aug 10 16:55:54.518192 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 108/211] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:54 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:54.531814 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d9d537fa-086f-4919-8fba-2aa4dcad7af8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:54.532558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d9d537fa-086f-4919-8fba-2aa4dcad7af8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:54.538530 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d537fa-086f-4919-8fba-2aa4dcad7af8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:54.539086 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d537fa-086f-4919-8fba-2aa4dcad7af8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:54.539522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d537fa-086f-4919-8fba-2aa4dcad7af8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:54.540267 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d537fa-086f-4919-8fba-2aa4dcad7af8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:54.540720 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d537fa-086f-4919-8fba-2aa4dcad7af8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:54.541160 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d537fa-086f-4919-8fba-2aa4dcad7af8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:54.663881 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9d537fa-086f-4919-8fba-2aa4dcad7af8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:54.671971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d9d537fa-086f-4919-8fba-2aa4dcad7af8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.144872 Aug 10 16:55:54.672696 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 104/212] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:54 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:54.875636 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b0bab57f-0774-40af-8564-0b699892f082 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:54.876187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b0bab57f-0774-40af-8564-0b699892f082 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:54.881986 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0bab57f-0774-40af-8564-0b699892f082 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:54.882468 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0bab57f-0774-40af-8564-0b699892f082 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:54.882898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0bab57f-0774-40af-8564-0b699892f082 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:54.883575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0bab57f-0774-40af-8564-0b699892f082 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:54.884021 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0bab57f-0774-40af-8564-0b699892f082 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:54.884471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0bab57f-0774-40af-8564-0b699892f082 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:55.009344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b0bab57f-0774-40af-8564-0b699892f082 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:55.017258 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b0bab57f-0774-40af-8564-0b699892f082 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.145458 Aug 10 16:55:55.017817 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 109/213] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:54 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:55.371331 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-26bf1754-710f-414b-97f5-127e718d2813 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:55.371942 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-26bf1754-710f-414b-97f5-127e718d2813 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:55.378223 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26bf1754-710f-414b-97f5-127e718d2813 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:55.378709 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26bf1754-710f-414b-97f5-127e718d2813 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:55.379419 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26bf1754-710f-414b-97f5-127e718d2813 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:55.380119 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26bf1754-710f-414b-97f5-127e718d2813 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:55.380599 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26bf1754-710f-414b-97f5-127e718d2813 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:55.381025 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26bf1754-710f-414b-97f5-127e718d2813 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:55.516531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-26bf1754-710f-414b-97f5-127e718d2813 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:55.523785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-26bf1754-710f-414b-97f5-127e718d2813 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.156833 Aug 10 16:55:55.524386 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 105/214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:55 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:55.540499 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:55.541107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:55.546907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:55.547390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:55.547822 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:55.548526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:55.548974 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:55.549393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:55.694442 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3a2d106d-81b7-42ce-b70b-8f7229ef8875 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:55.695172 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3a2d106d-81b7-42ce-b70b-8f7229ef8875 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:55.701323 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a2d106d-81b7-42ce-b70b-8f7229ef8875 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:55.701882 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a2d106d-81b7-42ce-b70b-8f7229ef8875 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:55.702407 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a2d106d-81b7-42ce-b70b-8f7229ef8875 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:55.703169 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a2d106d-81b7-42ce-b70b-8f7229ef8875 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:55.703803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a2d106d-81b7-42ce-b70b-8f7229ef8875 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:55.704187 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a2d106d-81b7-42ce-b70b-8f7229ef8875 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:55.834733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:55.843433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:55.845030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:55.846081 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cc90a05a-fb86-4272-a649-fd6cfe1851bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.309534 Aug 10 16:55:55.846817 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 110/215] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:55 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:55.863142 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-3a2d106d-81b7-42ce-b70b-8f7229ef8875 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:55.871909 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3a2d106d-81b7-42ce-b70b-8f7229ef8875 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.181460 Aug 10 16:55:55.872713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 106/216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:55 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:56.038337 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-45292343-5cc3-4d47-9a8a-1a446c8b626e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:56.038859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-45292343-5cc3-4d47-9a8a-1a446c8b626e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:56.045551 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45292343-5cc3-4d47-9a8a-1a446c8b626e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:56.046030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45292343-5cc3-4d47-9a8a-1a446c8b626e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:56.046459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45292343-5cc3-4d47-9a8a-1a446c8b626e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:56.047137 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45292343-5cc3-4d47-9a8a-1a446c8b626e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:56.047581 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45292343-5cc3-4d47-9a8a-1a446c8b626e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:56.048028 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45292343-5cc3-4d47-9a8a-1a446c8b626e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:56.174986 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-45292343-5cc3-4d47-9a8a-1a446c8b626e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:56.182816 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-45292343-5cc3-4d47-9a8a-1a446c8b626e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.148406 Aug 10 16:55:56.183369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 111/217] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:56 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:56.545939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cae74631-da81-4cb5-9147-94acfce66b4c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:56.546687 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cae74631-da81-4cb5-9147-94acfce66b4c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:56.554152 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae74631-da81-4cb5-9147-94acfce66b4c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:56.554643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae74631-da81-4cb5-9147-94acfce66b4c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:56.555076 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae74631-da81-4cb5-9147-94acfce66b4c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:56.559322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae74631-da81-4cb5-9147-94acfce66b4c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:56.560206 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae74631-da81-4cb5-9147-94acfce66b4c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:56.560814 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae74631-da81-4cb5-9147-94acfce66b4c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:56.705492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-cae74631-da81-4cb5-9147-94acfce66b4c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:56.713825 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cae74631-da81-4cb5-9147-94acfce66b4c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.173623 Aug 10 16:55:56.714389 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 107/218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:56 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:56.869865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:56.870473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:56.876305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:56.876785 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:56.877219 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:56.877903 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:56.878350 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:56.878768 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:56.893676 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4bd0e6df-500a-4fbf-a1a4-825bd1a173c5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:56.894286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4bd0e6df-500a-4fbf-a1a4-825bd1a173c5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:56.900115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6df-500a-4fbf-a1a4-825bd1a173c5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:56.901193 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6df-500a-4fbf-a1a4-825bd1a173c5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:56.901628 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6df-500a-4fbf-a1a4-825bd1a173c5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:56.902314 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6df-500a-4fbf-a1a4-825bd1a173c5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:56.902767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6df-500a-4fbf-a1a4-825bd1a173c5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:56.903190 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6df-500a-4fbf-a1a4-825bd1a173c5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:57.008361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:57.016531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:57.018065 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:57.019171 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d621b1e0-afb5-4978-9ae1-446dee6ef7fc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.153112 Aug 10 16:55:57.019731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 112/219] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:56 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:57.037070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4bd0e6df-500a-4fbf-a1a4-825bd1a173c5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:57.045615 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4bd0e6df-500a-4fbf-a1a4-825bd1a173c5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.155796 Aug 10 16:55:57.046172 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 108/220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:56 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:57.203721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2d095f8f-91c2-44c1-bf8f-3dab7d2aad0f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:57.204379 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2d095f8f-91c2-44c1-bf8f-3dab7d2aad0f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:57.210541 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d095f8f-91c2-44c1-bf8f-3dab7d2aad0f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:57.211018 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d095f8f-91c2-44c1-bf8f-3dab7d2aad0f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:57.211448 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d095f8f-91c2-44c1-bf8f-3dab7d2aad0f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:57.212129 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d095f8f-91c2-44c1-bf8f-3dab7d2aad0f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:57.212603 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d095f8f-91c2-44c1-bf8f-3dab7d2aad0f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:57.213674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d095f8f-91c2-44c1-bf8f-3dab7d2aad0f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:57.231334 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:57.339114 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2d095f8f-91c2-44c1-bf8f-3dab7d2aad0f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:57.346493 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2d095f8f-91c2-44c1-bf8f-3dab7d2aad0f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.146608 Aug 10 16:55:57.347058 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 113/221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:57 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:57.734639 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1e4b3f0b-c7fe-492b-8b18-6c1fb8fdd484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:57.735246 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1e4b3f0b-c7fe-492b-8b18-6c1fb8fdd484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:57.741705 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e4b3f0b-c7fe-492b-8b18-6c1fb8fdd484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:57.742189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e4b3f0b-c7fe-492b-8b18-6c1fb8fdd484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:57.742620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e4b3f0b-c7fe-492b-8b18-6c1fb8fdd484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:57.743306 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e4b3f0b-c7fe-492b-8b18-6c1fb8fdd484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:57.743757 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e4b3f0b-c7fe-492b-8b18-6c1fb8fdd484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:57.744699 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e4b3f0b-c7fe-492b-8b18-6c1fb8fdd484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:57.869100 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1e4b3f0b-c7fe-492b-8b18-6c1fb8fdd484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:57.877534 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1e4b3f0b-c7fe-492b-8b18-6c1fb8fdd484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.146676 Aug 10 16:55:57.891257 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 109/222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:57 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:58.042132 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:58.042724 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:58.048565 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:58.049041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:58.049468 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:58.050140 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:58.050580 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:58.050994 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:58.066249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c1a36f0c-55fc-4c52-b0c8-e1b731815b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:58.066861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c1a36f0c-55fc-4c52-b0c8-e1b731815b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:58.072722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1a36f0c-55fc-4c52-b0c8-e1b731815b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:58.073212 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1a36f0c-55fc-4c52-b0c8-e1b731815b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:58.073654 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1a36f0c-55fc-4c52-b0c8-e1b731815b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:58.074348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1a36f0c-55fc-4c52-b0c8-e1b731815b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:58.074809 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1a36f0c-55fc-4c52-b0c8-e1b731815b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:58.075237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1a36f0c-55fc-4c52-b0c8-e1b731815b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:58.211269 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c1a36f0c-55fc-4c52-b0c8-e1b731815b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:58.219648 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c1a36f0c-55fc-4c52-b0c8-e1b731815b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.157143 Aug 10 16:55:58.220673 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 110/223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:58 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:58.366072 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:58.367350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a08c081c-03bd-454a-9f70-ce0c9240cadc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:58.367955 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a08c081c-03bd-454a-9f70-ce0c9240cadc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:58.374026 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a08c081c-03bd-454a-9f70-ce0c9240cadc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:58.374489 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:58.374624 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a08c081c-03bd-454a-9f70-ce0c9240cadc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:58.374943 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a08c081c-03bd-454a-9f70-ce0c9240cadc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:58.375781 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a08c081c-03bd-454a-9f70-ce0c9240cadc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:58.376263 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a08c081c-03bd-454a-9f70-ce0c9240cadc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:58.376691 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a08c081c-03bd-454a-9f70-ce0c9240cadc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:58.377495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:58.379412 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c8ffbd6d-4218-41e8-8c33-8b9b1171c1e5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.341378 Aug 10 16:55:58.379709 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 114/224] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:58 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:58.505955 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a08c081c-03bd-454a-9f70-ce0c9240cadc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:58.513208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a08c081c-03bd-454a-9f70-ce0c9240cadc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.149669 Aug 10 16:55:58.513767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 111/225] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:58 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:55:58.898446 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b081ab41-5705-4686-abe2-2bdc0abed9ca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:58.899054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b081ab41-5705-4686-abe2-2bdc0abed9ca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:58.905461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b081ab41-5705-4686-abe2-2bdc0abed9ca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:58.905940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b081ab41-5705-4686-abe2-2bdc0abed9ca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:58.906372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b081ab41-5705-4686-abe2-2bdc0abed9ca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:58.907066 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b081ab41-5705-4686-abe2-2bdc0abed9ca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:58.907512 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b081ab41-5705-4686-abe2-2bdc0abed9ca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:58.907933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b081ab41-5705-4686-abe2-2bdc0abed9ca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:59.044071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b081ab41-5705-4686-abe2-2bdc0abed9ca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:59.051603 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b081ab41-5705-4686-abe2-2bdc0abed9ca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.157018 Aug 10 16:55:59.052183 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 115/226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:58 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:59.242175 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eca0baba-a634-4419-8f8b-da0f84baba90 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:59.242778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eca0baba-a634-4419-8f8b-da0f84baba90 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:59.249955 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eca0baba-a634-4419-8f8b-da0f84baba90 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:59.250436 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eca0baba-a634-4419-8f8b-da0f84baba90 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:59.250863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eca0baba-a634-4419-8f8b-da0f84baba90 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:59.251541 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eca0baba-a634-4419-8f8b-da0f84baba90 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:59.251986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eca0baba-a634-4419-8f8b-da0f84baba90 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:59.252433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eca0baba-a634-4419-8f8b-da0f84baba90 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:59.380674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-eca0baba-a634-4419-8f8b-da0f84baba90 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:59.388847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eca0baba-a634-4419-8f8b-da0f84baba90 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.150739 Aug 10 16:55:59.389419 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 112/227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:59 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:55:59.401633 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:59.402241 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:59.408049 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:59.408616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:59.409047 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:59.409726 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:59.410173 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:59.410591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:59.534385 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-33587d84-e151-4c26-b28d-eb1a0e7054a9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:55:59.535002 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-33587d84-e151-4c26-b28d-eb1a0e7054a9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:55:59.537869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:59.541957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33587d84-e151-4c26-b28d-eb1a0e7054a9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:59.542548 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33587d84-e151-4c26-b28d-eb1a0e7054a9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:59.543052 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33587d84-e151-4c26-b28d-eb1a0e7054a9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:59.543886 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33587d84-e151-4c26-b28d-eb1a0e7054a9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:55:59.544437 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33587d84-e151-4c26-b28d-eb1a0e7054a9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:55:59.544935 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33587d84-e151-4c26-b28d-eb1a0e7054a9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:55:59.546247 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:59.547734 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:59.548860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f9428fee-3bef-42a4-8e01-78f4d547afe4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.151072 Aug 10 16:55:59.549416 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 116/228] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:55:59 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:55:59.668690 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-33587d84-e151-4c26-b28d-eb1a0e7054a9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:55:59.676102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-33587d84-e151-4c26-b28d-eb1a0e7054a9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.145734 Aug 10 16:55:59.676696 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 113/229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:55:59 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:00.071844 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b511488a-9665-48bb-99fa-fda781421b5d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:00.072459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b511488a-9665-48bb-99fa-fda781421b5d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:00.078331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b511488a-9665-48bb-99fa-fda781421b5d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:00.078819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b511488a-9665-48bb-99fa-fda781421b5d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:00.079277 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b511488a-9665-48bb-99fa-fda781421b5d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:00.079955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b511488a-9665-48bb-99fa-fda781421b5d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:00.080435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b511488a-9665-48bb-99fa-fda781421b5d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:00.080854 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b511488a-9665-48bb-99fa-fda781421b5d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:00.210670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b511488a-9665-48bb-99fa-fda781421b5d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:00.219606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b511488a-9665-48bb-99fa-fda781421b5d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.151203 Aug 10 16:56:00.220276 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 117/230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:00 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:00.409407 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b773a2e8-c921-4ec4-82cc-e176fb33aad6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:00.409996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b773a2e8-c921-4ec4-82cc-e176fb33aad6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:00.416598 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b773a2e8-c921-4ec4-82cc-e176fb33aad6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:00.417087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b773a2e8-c921-4ec4-82cc-e176fb33aad6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:00.417522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b773a2e8-c921-4ec4-82cc-e176fb33aad6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:00.418217 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b773a2e8-c921-4ec4-82cc-e176fb33aad6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:00.418698 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b773a2e8-c921-4ec4-82cc-e176fb33aad6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:00.419122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b773a2e8-c921-4ec4-82cc-e176fb33aad6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:00.544198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b773a2e8-c921-4ec4-82cc-e176fb33aad6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:00.551456 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b773a2e8-c921-4ec4-82cc-e176fb33aad6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.145925 Aug 10 16:56:00.552022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 114/231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:00 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:00.570713 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:00.571310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:00.577591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:00.578064 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:00.578573 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:00.579257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:00.579701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:00.580204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:00.698897 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19c1983a-fedc-4384-8d22-8e5163f72939 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:00.699551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-19c1983a-fedc-4384-8d22-8e5163f72939 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:00.704425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:00.705577 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c1983a-fedc-4384-8d22-8e5163f72939 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:00.706061 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c1983a-fedc-4384-8d22-8e5163f72939 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:00.706492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c1983a-fedc-4384-8d22-8e5163f72939 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:00.707237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c1983a-fedc-4384-8d22-8e5163f72939 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:00.707895 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c1983a-fedc-4384-8d22-8e5163f72939 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:00.708348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c1983a-fedc-4384-8d22-8e5163f72939 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:00.712947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:00.714465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:00.715908 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-dc466880-92a8-4b02-92ce-6c4ac10f20c9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.149014 Aug 10 16:56:00.716568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 118/232] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:00 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:00.837281 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-19c1983a-fedc-4384-8d22-8e5163f72939 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:00.844430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19c1983a-fedc-4384-8d22-8e5163f72939 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.149893 Aug 10 16:56:00.845159 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 115/233] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:00 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:01.239738 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0715ad5a-3d19-491d-ae1d-2438d57699e2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:01.240401 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0715ad5a-3d19-491d-ae1d-2438d57699e2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:01.246958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0715ad5a-3d19-491d-ae1d-2438d57699e2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:01.247457 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0715ad5a-3d19-491d-ae1d-2438d57699e2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:01.247874 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0715ad5a-3d19-491d-ae1d-2438d57699e2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:01.248707 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0715ad5a-3d19-491d-ae1d-2438d57699e2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:01.249196 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0715ad5a-3d19-491d-ae1d-2438d57699e2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:01.249611 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0715ad5a-3d19-491d-ae1d-2438d57699e2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:01.390246 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0715ad5a-3d19-491d-ae1d-2438d57699e2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:01.397609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0715ad5a-3d19-491d-ae1d-2438d57699e2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.161681 Aug 10 16:56:01.398165 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 119/234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:01 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:01.572391 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0cc5adad-6869-419a-8eb3-077e4b1b8747 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:01.572899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0cc5adad-6869-419a-8eb3-077e4b1b8747 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:01.579228 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cc5adad-6869-419a-8eb3-077e4b1b8747 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:01.579705 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cc5adad-6869-419a-8eb3-077e4b1b8747 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:01.580135 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cc5adad-6869-419a-8eb3-077e4b1b8747 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:01.580840 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cc5adad-6869-419a-8eb3-077e4b1b8747 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:01.581312 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cc5adad-6869-419a-8eb3-077e4b1b8747 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:01.581726 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cc5adad-6869-419a-8eb3-077e4b1b8747 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:01.720561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0cc5adad-6869-419a-8eb3-077e4b1b8747 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:01.727984 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0cc5adad-6869-419a-8eb3-077e4b1b8747 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.159512 Aug 10 16:56:01.728605 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 116/235] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:01 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:01.737658 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:01.738340 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:01.744227 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:01.744702 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:01.745127 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:01.745826 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:01.746268 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:01.746682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:01.865270 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67aafa72-850d-4875-b44a-73bb0d6a5aaf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:01.866141 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-67aafa72-850d-4875-b44a-73bb0d6a5aaf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:01.873286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67aafa72-850d-4875-b44a-73bb0d6a5aaf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:01.873811 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67aafa72-850d-4875-b44a-73bb0d6a5aaf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:01.873976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:01.874400 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67aafa72-850d-4875-b44a-73bb0d6a5aaf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:01.875106 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67aafa72-850d-4875-b44a-73bb0d6a5aaf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:01.875585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67aafa72-850d-4875-b44a-73bb0d6a5aaf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:01.876014 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67aafa72-850d-4875-b44a-73bb0d6a5aaf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:01.882123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:01.883629 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:01.885293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-da99e981-b7c7-400f-943d-97ff5e392570 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.150872 Aug 10 16:56:01.885854 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 120/236] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:01 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:02.005795 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-67aafa72-850d-4875-b44a-73bb0d6a5aaf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:02.013539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67aafa72-850d-4875-b44a-73bb0d6a5aaf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.152898 Aug 10 16:56:02.014098 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 117/237] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:01 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:02.419099 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-532631eb-3df6-4032-a37d-d18185b7cbda tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:02.419709 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-532631eb-3df6-4032-a37d-d18185b7cbda tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:02.425575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-532631eb-3df6-4032-a37d-d18185b7cbda tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:02.426053 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-532631eb-3df6-4032-a37d-d18185b7cbda tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:02.426481 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-532631eb-3df6-4032-a37d-d18185b7cbda tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:02.427163 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-532631eb-3df6-4032-a37d-d18185b7cbda tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:02.427617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-532631eb-3df6-4032-a37d-d18185b7cbda tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:02.428035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-532631eb-3df6-4032-a37d-d18185b7cbda tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:02.555724 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-532631eb-3df6-4032-a37d-d18185b7cbda tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:02.563664 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-532631eb-3df6-4032-a37d-d18185b7cbda tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.148897 Aug 10 16:56:02.564257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 121/238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:02 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:02.748689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0299f6d6-c57d-4577-bfc9-9f4b4e052c9f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:02.749296 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0299f6d6-c57d-4577-bfc9-9f4b4e052c9f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:02.755583 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0299f6d6-c57d-4577-bfc9-9f4b4e052c9f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:02.756059 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0299f6d6-c57d-4577-bfc9-9f4b4e052c9f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:02.756540 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0299f6d6-c57d-4577-bfc9-9f4b4e052c9f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:02.757218 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0299f6d6-c57d-4577-bfc9-9f4b4e052c9f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:02.757668 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0299f6d6-c57d-4577-bfc9-9f4b4e052c9f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:02.758089 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0299f6d6-c57d-4577-bfc9-9f4b4e052c9f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:02.882396 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0299f6d6-c57d-4577-bfc9-9f4b4e052c9f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:02.889916 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0299f6d6-c57d-4577-bfc9-9f4b4e052c9f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.145665 Aug 10 16:56:02.890486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 118/239] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:02 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:02.907319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:02.907920 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:02.913787 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:02.914265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:02.914690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:02.915398 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:02.915845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:02.916885 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:03.035642 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-66e5f8b9-29e4-4e03-9bbe-9ea9fed0207c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:03.036458 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-66e5f8b9-29e4-4e03-9bbe-9ea9fed0207c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:03.043689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66e5f8b9-29e4-4e03-9bbe-9ea9fed0207c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:03.044402 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66e5f8b9-29e4-4e03-9bbe-9ea9fed0207c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:03.044830 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66e5f8b9-29e4-4e03-9bbe-9ea9fed0207c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:03.045655 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66e5f8b9-29e4-4e03-9bbe-9ea9fed0207c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:03.046239 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66e5f8b9-29e4-4e03-9bbe-9ea9fed0207c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:03.046848 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66e5f8b9-29e4-4e03-9bbe-9ea9fed0207c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:03.057405 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:03.065354 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:03.065512 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:03.066868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:03.067998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-78f65a0b-43ba-4953-8709-104706616f3f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.164612 Aug 10 16:56:03.068597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 122/240] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:02 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:03.179766 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-66e5f8b9-29e4-4e03-9bbe-9ea9fed0207c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:03.187991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-66e5f8b9-29e4-4e03-9bbe-9ea9fed0207c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.156635 Aug 10 16:56:03.188710 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 119/241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:03 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:03.584453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b1dbf6df-14cc-44f4-862a-874681d288bf tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:03.584953 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b1dbf6df-14cc-44f4-862a-874681d288bf tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:03.590842 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1dbf6df-14cc-44f4-862a-874681d288bf tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:03.591317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1dbf6df-14cc-44f4-862a-874681d288bf tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:03.591745 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1dbf6df-14cc-44f4-862a-874681d288bf tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:03.592441 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1dbf6df-14cc-44f4-862a-874681d288bf tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:03.592884 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1dbf6df-14cc-44f4-862a-874681d288bf tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:03.593298 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1dbf6df-14cc-44f4-862a-874681d288bf tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:03.719129 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b1dbf6df-14cc-44f4-862a-874681d288bf tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:03.726624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b1dbf6df-14cc-44f4-862a-874681d288bf tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.146290 Aug 10 16:56:03.727545 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 123/242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:03 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:03.910855 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-49448e83-cc94-47ed-bfa4-15fac2003dcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:03.911400 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-49448e83-cc94-47ed-bfa4-15fac2003dcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:03.918221 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49448e83-cc94-47ed-bfa4-15fac2003dcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:03.918703 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49448e83-cc94-47ed-bfa4-15fac2003dcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:03.919136 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49448e83-cc94-47ed-bfa4-15fac2003dcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:03.919823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49448e83-cc94-47ed-bfa4-15fac2003dcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:03.920320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49448e83-cc94-47ed-bfa4-15fac2003dcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:03.920746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49448e83-cc94-47ed-bfa4-15fac2003dcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:04.047468 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-49448e83-cc94-47ed-bfa4-15fac2003dcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:04.054915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-49448e83-cc94-47ed-bfa4-15fac2003dcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.147928 Aug 10 16:56:04.055478 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 120/243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:03 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:04.092284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:04.093142 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:04.098916 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:04.099388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:04.099815 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:04.100522 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:04.100961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:04.101375 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:04.209723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99569e58-1016-4620-8bc1-57d6345c526b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:04.210333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-99569e58-1016-4620-8bc1-57d6345c526b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:04.217618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99569e58-1016-4620-8bc1-57d6345c526b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:04.217618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99569e58-1016-4620-8bc1-57d6345c526b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:04.217618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99569e58-1016-4620-8bc1-57d6345c526b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:04.218121 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99569e58-1016-4620-8bc1-57d6345c526b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:04.218584 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99569e58-1016-4620-8bc1-57d6345c526b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:04.219012 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99569e58-1016-4620-8bc1-57d6345c526b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:04.237922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:04.251695 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:04.253448 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:04.254682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f6fb3dd6-fd8a-417e-bff5-e6051cd8a216 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.167210 Aug 10 16:56:04.255600 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 124/244] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:04 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:04.357064 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-99569e58-1016-4620-8bc1-57d6345c526b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:04.364387 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-99569e58-1016-4620-8bc1-57d6345c526b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.158779 Aug 10 16:56:04.364950 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 121/245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:04 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:04.747359 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cf6779b0-14fc-4332-9d2d-80643f17d28c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:04.747967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cf6779b0-14fc-4332-9d2d-80643f17d28c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:04.753859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf6779b0-14fc-4332-9d2d-80643f17d28c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:04.754343 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf6779b0-14fc-4332-9d2d-80643f17d28c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:04.754777 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf6779b0-14fc-4332-9d2d-80643f17d28c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:04.755462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf6779b0-14fc-4332-9d2d-80643f17d28c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:04.755913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf6779b0-14fc-4332-9d2d-80643f17d28c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:04.756366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf6779b0-14fc-4332-9d2d-80643f17d28c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:04.879529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cf6779b0-14fc-4332-9d2d-80643f17d28c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:04.886823 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cf6779b0-14fc-4332-9d2d-80643f17d28c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.143919 Aug 10 16:56:04.887381 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 125/246] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:04 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:05.077011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ff674c4-bed6-41bc-b218-b0542e330db8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:05.077616 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ff674c4-bed6-41bc-b218-b0542e330db8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:05.084226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff674c4-bed6-41bc-b218-b0542e330db8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:05.084709 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff674c4-bed6-41bc-b218-b0542e330db8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:05.085145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff674c4-bed6-41bc-b218-b0542e330db8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:05.085830 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff674c4-bed6-41bc-b218-b0542e330db8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:05.086280 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff674c4-bed6-41bc-b218-b0542e330db8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:05.086700 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff674c4-bed6-41bc-b218-b0542e330db8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:05.214547 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6ff674c4-bed6-41bc-b218-b0542e330db8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:05.221786 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ff674c4-bed6-41bc-b218-b0542e330db8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.149307 Aug 10 16:56:05.222354 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 122/247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:05 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:05.277196 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:05.277732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:05.283536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:05.284020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:05.284493 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:05.285184 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:05.285627 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:05.286050 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:05.387252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ab98c90-3296-4b0c-ad41-fd1f5a489188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:05.387999 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0ab98c90-3296-4b0c-ad41-fd1f5a489188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:05.393804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ab98c90-3296-4b0c-ad41-fd1f5a489188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:05.394287 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ab98c90-3296-4b0c-ad41-fd1f5a489188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:05.394721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ab98c90-3296-4b0c-ad41-fd1f5a489188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:05.395411 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ab98c90-3296-4b0c-ad41-fd1f5a489188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:05.395860 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ab98c90-3296-4b0c-ad41-fd1f5a489188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:05.396315 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ab98c90-3296-4b0c-ad41-fd1f5a489188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:05.423360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:05.432589 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:05.434267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:05.435394 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-18891dde-8891-4ad7-82b9-cfda2a0271a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.162736 Aug 10 16:56:05.435943 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 126/248] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:05 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:05.532252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ab98c90-3296-4b0c-ad41-fd1f5a489188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:05.539544 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0ab98c90-3296-4b0c-ad41-fd1f5a489188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.156766 Aug 10 16:56:05.540100 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 123/249] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:05 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:05.717682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-761ea344-25c3-4963-b44b-cff9c39c9026 req-9bf560ee-9ca5-492c-b957-53c0c4b5c77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c45104f-0ee5-4fec-92ad-7937cbe53805", "name": "network-vif-plugged", "status": "completed", "tag": "da10f762-bc62-4992-aee6-1b182938963c"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:56:05.727564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-761ea344-25c3-4963-b44b-cff9c39c9026 req-9bf560ee-9ca5-492c-b957-53c0c4b5c77c service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:05.728119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-761ea344-25c3-4963-b44b-cff9c39c9026 req-9bf560ee-9ca5-492c-b957-53c0c4b5c77c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:05.729087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-761ea344-25c3-4963-b44b-cff9c39c9026 req-9bf560ee-9ca5-492c-b957-53c0c4b5c77c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:05.742763 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-761ea344-25c3-4963-b44b-cff9c39c9026 req-9bf560ee-9ca5-492c-b957-53c0c4b5c77c service nova] Creating event network-vif-plugged:da10f762-bc62-4992-aee6-1b182938963c for instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 on hv-cinder-83602 Aug 10 16:56:05.748875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-761ea344-25c3-4963-b44b-cff9c39c9026 req-9bf560ee-9ca5-492c-b957-53c0c4b5c77c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034799 Aug 10 16:56:05.749849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 127/250] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:56:05.907220 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-13b9e5cf-d161-414a-9709-d60045582257 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:05.907820 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-13b9e5cf-d161-414a-9709-d60045582257 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:05.913986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13b9e5cf-d161-414a-9709-d60045582257 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:05.914465 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13b9e5cf-d161-414a-9709-d60045582257 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:05.914895 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13b9e5cf-d161-414a-9709-d60045582257 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:05.915568 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13b9e5cf-d161-414a-9709-d60045582257 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:05.916015 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13b9e5cf-d161-414a-9709-d60045582257 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:05.917095 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13b9e5cf-d161-414a-9709-d60045582257 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:06.044160 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-13b9e5cf-d161-414a-9709-d60045582257 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:06.051991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-13b9e5cf-d161-414a-9709-d60045582257 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.148521 Aug 10 16:56:06.052596 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 124/251] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:05 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:06.243341 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1dfe023c-a014-4ced-9891-c78971512071 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:06.244026 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1dfe023c-a014-4ced-9891-c78971512071 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:06.250071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1dfe023c-a014-4ced-9891-c78971512071 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:06.250547 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1dfe023c-a014-4ced-9891-c78971512071 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:06.250978 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1dfe023c-a014-4ced-9891-c78971512071 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:06.251654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1dfe023c-a014-4ced-9891-c78971512071 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:06.252108 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1dfe023c-a014-4ced-9891-c78971512071 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:06.252553 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1dfe023c-a014-4ced-9891-c78971512071 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:06.386306 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1dfe023c-a014-4ced-9891-c78971512071 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:06.392843 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1dfe023c-a014-4ced-9891-c78971512071 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.153701 Aug 10 16:56:06.398658 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 128/252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:06 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:06.457024 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:06.457962 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:06.464904 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:06.465498 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:06.465891 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:06.466604 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:06.467011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:06.467433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:06.559344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-301d1286-24d3-4387-9625-a4809a6b7232 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:06.559873 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-301d1286-24d3-4387-9625-a4809a6b7232 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:06.566022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-301d1286-24d3-4387-9625-a4809a6b7232 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:06.566585 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-301d1286-24d3-4387-9625-a4809a6b7232 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:06.567200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-301d1286-24d3-4387-9625-a4809a6b7232 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:06.568067 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-301d1286-24d3-4387-9625-a4809a6b7232 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:06.568704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-301d1286-24d3-4387-9625-a4809a6b7232 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:06.569119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-301d1286-24d3-4387-9625-a4809a6b7232 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:06.612364 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:06.621753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:06.623499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:06.624731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8130103f-f8bf-4aab-bfe5-1af08293e70b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.172040 Aug 10 16:56:06.625295 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 125/253] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:06 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:06.715074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-301d1286-24d3-4387-9625-a4809a6b7232 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:06.723298 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-301d1286-24d3-4387-9625-a4809a6b7232 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.167415 Aug 10 16:56:06.723889 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 129/254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:06 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:07.073727 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2f4e52fa-9bed-4c44-b086-0ec84d6d1906 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:07.074326 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2f4e52fa-9bed-4c44-b086-0ec84d6d1906 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:07.080546 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f4e52fa-9bed-4c44-b086-0ec84d6d1906 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:07.081030 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f4e52fa-9bed-4c44-b086-0ec84d6d1906 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:07.081464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f4e52fa-9bed-4c44-b086-0ec84d6d1906 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:07.082151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f4e52fa-9bed-4c44-b086-0ec84d6d1906 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:07.082853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f4e52fa-9bed-4c44-b086-0ec84d6d1906 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:07.083272 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f4e52fa-9bed-4c44-b086-0ec84d6d1906 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:07.250865 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2f4e52fa-9bed-4c44-b086-0ec84d6d1906 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:07.259888 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2f4e52fa-9bed-4c44-b086-0ec84d6d1906 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.190491 Aug 10 16:56:07.264185 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 126/255] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:07 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:07.419183 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9e40e9c1-dafe-451c-bc9a-0422d48ebf6f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:07.419957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9e40e9c1-dafe-451c-bc9a-0422d48ebf6f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:07.426485 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e40e9c1-dafe-451c-bc9a-0422d48ebf6f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:07.427118 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e40e9c1-dafe-451c-bc9a-0422d48ebf6f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:07.428052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e40e9c1-dafe-451c-bc9a-0422d48ebf6f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:07.428837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e40e9c1-dafe-451c-bc9a-0422d48ebf6f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:07.429291 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e40e9c1-dafe-451c-bc9a-0422d48ebf6f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:07.429868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e40e9c1-dafe-451c-bc9a-0422d48ebf6f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:07.572608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9e40e9c1-dafe-451c-bc9a-0422d48ebf6f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:07.576180 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:07.581034 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9e40e9c1-dafe-451c-bc9a-0422d48ebf6f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.166877 Aug 10 16:56:07.581604 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 130/256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:07 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:07.648379 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:07.648987 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:07.652424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:07.656445 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:07.656932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:07.657439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:07.658411 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:07.658861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:07.659313 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:07.750584 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-488ca3f7-8c21-45c2-9cdc-80ee760affc3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:07.751415 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-488ca3f7-8c21-45c2-9cdc-80ee760affc3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:07.757611 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-488ca3f7-8c21-45c2-9cdc-80ee760affc3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:07.758398 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-488ca3f7-8c21-45c2-9cdc-80ee760affc3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:07.758901 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-488ca3f7-8c21-45c2-9cdc-80ee760affc3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:07.759671 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-488ca3f7-8c21-45c2-9cdc-80ee760affc3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:07.760384 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-488ca3f7-8c21-45c2-9cdc-80ee760affc3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:07.760805 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-488ca3f7-8c21-45c2-9cdc-80ee760affc3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:07.986276 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-488ca3f7-8c21-45c2-9cdc-80ee760affc3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:08.001697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-488ca3f7-8c21-45c2-9cdc-80ee760affc3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.255753 Aug 10 16:56:08.002722 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 131/257] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:07 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:08.052046 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:08.062463 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:08.064033 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:08.065203 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9882c4a2-b4a9-4a78-9b41-e701061c8d8c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.420885 Aug 10 16:56:08.065765 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 127/258] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:07 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:08.284412 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9a56fd16-d72a-49d8-b3eb-45620b34d238 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:08.284412 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9a56fd16-d72a-49d8-b3eb-45620b34d238 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:08.287200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a56fd16-d72a-49d8-b3eb-45620b34d238 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:08.287965 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a56fd16-d72a-49d8-b3eb-45620b34d238 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:08.288862 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a56fd16-d72a-49d8-b3eb-45620b34d238 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:08.289986 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a56fd16-d72a-49d8-b3eb-45620b34d238 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:08.290779 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a56fd16-d72a-49d8-b3eb-45620b34d238 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:08.292099 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a56fd16-d72a-49d8-b3eb-45620b34d238 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:08.442452 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9a56fd16-d72a-49d8-b3eb-45620b34d238 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:08.450441 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9a56fd16-d72a-49d8-b3eb-45620b34d238 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.173709 Aug 10 16:56:08.451085 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 132/259] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:08 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:08.603141 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae939a02-5bb6-425f-afdc-406f61f9681a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:08.604409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ae939a02-5bb6-425f-afdc-406f61f9681a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:08.612235 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae939a02-5bb6-425f-afdc-406f61f9681a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:08.612821 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae939a02-5bb6-425f-afdc-406f61f9681a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:08.613351 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae939a02-5bb6-425f-afdc-406f61f9681a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:08.614123 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae939a02-5bb6-425f-afdc-406f61f9681a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:08.614645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae939a02-5bb6-425f-afdc-406f61f9681a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:08.615235 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae939a02-5bb6-425f-afdc-406f61f9681a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:08.763425 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ae939a02-5bb6-425f-afdc-406f61f9681a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:08.773988 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ae939a02-5bb6-425f-afdc-406f61f9681a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.174374 Aug 10 16:56:08.774172 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 128/260] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:08 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:09.024585 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d38de24b-8e49-4a28-8655-0b11a79da3b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:09.025157 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d38de24b-8e49-4a28-8655-0b11a79da3b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:09.031922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d38de24b-8e49-4a28-8655-0b11a79da3b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:09.032445 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d38de24b-8e49-4a28-8655-0b11a79da3b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:09.032880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d38de24b-8e49-4a28-8655-0b11a79da3b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:09.033570 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d38de24b-8e49-4a28-8655-0b11a79da3b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:09.034018 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d38de24b-8e49-4a28-8655-0b11a79da3b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:09.034467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d38de24b-8e49-4a28-8655-0b11a79da3b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:09.089313 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:09.089586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:09.097021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:09.097560 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:09.098216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:09.098915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:09.099524 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:09.100317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:09.218383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d38de24b-8e49-4a28-8655-0b11a79da3b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:09.229337 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d38de24b-8e49-4a28-8655-0b11a79da3b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.207589 Aug 10 16:56:09.230237 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 133/261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:09 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:09.296660 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:09.304718 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:09.306236 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:09.308190 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-093a65bc-ce80-4906-ab0e-cda260ad676b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.223443 Aug 10 16:56:09.308748 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 129/262] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:09 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:56:09.472118 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-064dfeba-9335-4ef4-a53f-d8631fb71bdc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:09.472759 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-064dfeba-9335-4ef4-a53f-d8631fb71bdc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:09.482229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-064dfeba-9335-4ef4-a53f-d8631fb71bdc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:09.482229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-064dfeba-9335-4ef4-a53f-d8631fb71bdc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:09.482229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-064dfeba-9335-4ef4-a53f-d8631fb71bdc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:09.482229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-064dfeba-9335-4ef4-a53f-d8631fb71bdc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:09.488369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-064dfeba-9335-4ef4-a53f-d8631fb71bdc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:09.488873 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-064dfeba-9335-4ef4-a53f-d8631fb71bdc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:09.680100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-064dfeba-9335-4ef4-a53f-d8631fb71bdc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:09.695352 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-064dfeba-9335-4ef4-a53f-d8631fb71bdc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.226451 Aug 10 16:56:09.696335 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 134/263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:09 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:09.795826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-98d2a9f3-b1b4-4a70-8c4a-991b83eff47e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:09.796566 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-98d2a9f3-b1b4-4a70-8c4a-991b83eff47e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:09.805075 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98d2a9f3-b1b4-4a70-8c4a-991b83eff47e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:09.805584 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98d2a9f3-b1b4-4a70-8c4a-991b83eff47e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:09.806442 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98d2a9f3-b1b4-4a70-8c4a-991b83eff47e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:09.807745 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98d2a9f3-b1b4-4a70-8c4a-991b83eff47e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:09.808289 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98d2a9f3-b1b4-4a70-8c4a-991b83eff47e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:09.808896 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98d2a9f3-b1b4-4a70-8c4a-991b83eff47e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:10.013425 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-98d2a9f3-b1b4-4a70-8c4a-991b83eff47e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:10.023319 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-98d2a9f3-b1b4-4a70-8c4a-991b83eff47e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.231760 Aug 10 16:56:10.024490 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 130/264] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:09 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:10.061607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-ea54f398-1f52-4784-8ae4-2cd98644deb8 req-e1c7d45a-f180-4247-b036-48022bb3ba63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993a10bf-b49d-4027-b117-d167712152e0", "name": "network-vif-plugged", "status": "completed", "tag": "0a60f022-b759-4dc7-8144-208e6c5d1ad3"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:56:10.071164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ea54f398-1f52-4784-8ae4-2cd98644deb8 req-e1c7d45a-f180-4247-b036-48022bb3ba63 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:10.071778 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ea54f398-1f52-4784-8ae4-2cd98644deb8 req-e1c7d45a-f180-4247-b036-48022bb3ba63 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:10.072942 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ea54f398-1f52-4784-8ae4-2cd98644deb8 req-e1c7d45a-f180-4247-b036-48022bb3ba63 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:10.085479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-ea54f398-1f52-4784-8ae4-2cd98644deb8 req-e1c7d45a-f180-4247-b036-48022bb3ba63 service nova] Creating event network-vif-plugged:0a60f022-b759-4dc7-8144-208e6c5d1ad3 for instance 993a10bf-b49d-4027-b117-d167712152e0 on hv-cinder-83602 Aug 10 16:56:10.091752 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-ea54f398-1f52-4784-8ae4-2cd98644deb8 req-e1c7d45a-f180-4247-b036-48022bb3ba63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034299 Aug 10 16:56:10.092978 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 135/265] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:56:10.250192 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d3a93aab-feb7-4ca9-a8e7-0517a9a5c7c5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:10.250779 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d3a93aab-feb7-4ca9-a8e7-0517a9a5c7c5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:10.256659 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a93aab-feb7-4ca9-a8e7-0517a9a5c7c5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:10.262216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a93aab-feb7-4ca9-a8e7-0517a9a5c7c5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:10.262216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a93aab-feb7-4ca9-a8e7-0517a9a5c7c5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:10.262216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a93aab-feb7-4ca9-a8e7-0517a9a5c7c5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:10.262216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a93aab-feb7-4ca9-a8e7-0517a9a5c7c5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:10.262496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a93aab-feb7-4ca9-a8e7-0517a9a5c7c5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:10.335248 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:10.336041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:10.339300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:10.343717 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:10.344135 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:10.344599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:10.345293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:10.345903 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:10.346546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:10.451906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d3a93aab-feb7-4ca9-a8e7-0517a9a5c7c5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:10.460165 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d3a93aab-feb7-4ca9-a8e7-0517a9a5c7c5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.213643 Aug 10 16:56:10.460746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 131/266] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:10 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:10.573286 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:10.583395 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:10.585266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:10.586501 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4ba5c26b-aa05-4873-931c-89148c08f8a2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.255655 Aug 10 16:56:10.587351 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 136/267] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:10 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:56:10.722930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2cc1661-4bff-4fc9-afaf-f4b3c0c4c8f9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:10.724139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a2cc1661-4bff-4fc9-afaf-f4b3c0c4c8f9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:10.755737 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cc1661-4bff-4fc9-afaf-f4b3c0c4c8f9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:10.756809 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cc1661-4bff-4fc9-afaf-f4b3c0c4c8f9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:10.759152 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cc1661-4bff-4fc9-afaf-f4b3c0c4c8f9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:10.759938 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cc1661-4bff-4fc9-afaf-f4b3c0c4c8f9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:10.761559 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cc1661-4bff-4fc9-afaf-f4b3c0c4c8f9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:10.762005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cc1661-4bff-4fc9-afaf-f4b3c0c4c8f9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:10.937072 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a2cc1661-4bff-4fc9-afaf-f4b3c0c4c8f9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:10.947069 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2cc1661-4bff-4fc9-afaf-f4b3c0c4c8f9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.227860 Aug 10 16:56:10.948221 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 132/268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:10 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:11.046730 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9acf310f-a57d-4c8c-8129-ba1057530c5f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:11.047390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9acf310f-a57d-4c8c-8129-ba1057530c5f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:11.059243 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9acf310f-a57d-4c8c-8129-ba1057530c5f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:11.061610 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9acf310f-a57d-4c8c-8129-ba1057530c5f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:11.063304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9acf310f-a57d-4c8c-8129-ba1057530c5f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:11.065438 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9acf310f-a57d-4c8c-8129-ba1057530c5f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:11.065978 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9acf310f-a57d-4c8c-8129-ba1057530c5f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:11.066414 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9acf310f-a57d-4c8c-8129-ba1057530c5f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:11.476637 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9acf310f-a57d-4c8c-8129-ba1057530c5f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:11.482768 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c91e5786-3445-4338-b449-acce87abbb94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:11.483766 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c91e5786-3445-4338-b449-acce87abbb94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:11.488284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9acf310f-a57d-4c8c-8129-ba1057530c5f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.444246 Aug 10 16:56:11.488284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 137/269] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:11 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:11.493854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91e5786-3445-4338-b449-acce87abbb94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:11.494539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91e5786-3445-4338-b449-acce87abbb94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:11.495712 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91e5786-3445-4338-b449-acce87abbb94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:11.496450 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91e5786-3445-4338-b449-acce87abbb94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:11.497112 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91e5786-3445-4338-b449-acce87abbb94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:11.497710 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91e5786-3445-4338-b449-acce87abbb94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:11.610967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:11.612178 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:11.618214 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:11.618964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:11.619803 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:11.621211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:11.621976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:11.622547 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:11.647798 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c91e5786-3445-4338-b449-acce87abbb94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:11.658193 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c91e5786-3445-4338-b449-acce87abbb94 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.180190 Aug 10 16:56:11.658911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 133/270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:11 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:11.794783 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:11.804686 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:11.807060 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:11.808374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-557e80e0-29f9-4d3e-8ac0-73fcdf2bc1c4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.201454 Aug 10 16:56:11.808932 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 138/271] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:11 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:56:11.973732 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6950f9c0-550d-4426-82d4-f2c78a558d30 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:11.975506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6950f9c0-550d-4426-82d4-f2c78a558d30 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:11.986170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6950f9c0-550d-4426-82d4-f2c78a558d30 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:11.987113 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6950f9c0-550d-4426-82d4-f2c78a558d30 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:11.987978 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6950f9c0-550d-4426-82d4-f2c78a558d30 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:11.989030 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6950f9c0-550d-4426-82d4-f2c78a558d30 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:11.990191 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6950f9c0-550d-4426-82d4-f2c78a558d30 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:11.990749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6950f9c0-550d-4426-82d4-f2c78a558d30 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:12.149851 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6950f9c0-550d-4426-82d4-f2c78a558d30 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:12.159933 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6950f9c0-550d-4426-82d4-f2c78a558d30 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.194237 Aug 10 16:56:12.160946 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 134/272] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:11 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:12.506533 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-20f7e4b8-33a0-4305-9659-777d1fce8c2c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:12.507128 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-20f7e4b8-33a0-4305-9659-777d1fce8c2c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:12.513909 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20f7e4b8-33a0-4305-9659-777d1fce8c2c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:12.514424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20f7e4b8-33a0-4305-9659-777d1fce8c2c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:12.515113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20f7e4b8-33a0-4305-9659-777d1fce8c2c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:12.516083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20f7e4b8-33a0-4305-9659-777d1fce8c2c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:12.516860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20f7e4b8-33a0-4305-9659-777d1fce8c2c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:12.517409 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20f7e4b8-33a0-4305-9659-777d1fce8c2c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:12.665609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-20f7e4b8-33a0-4305-9659-777d1fce8c2c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:12.679801 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-20f7e4b8-33a0-4305-9659-777d1fce8c2c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.175574 Aug 10 16:56:12.680433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 139/273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:12 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:12.683775 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9530de75-9e0e-4f68-bd68-85609b6830ca tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:12.684380 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9530de75-9e0e-4f68-bd68-85609b6830ca tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:12.690272 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9530de75-9e0e-4f68-bd68-85609b6830ca tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:12.690766 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9530de75-9e0e-4f68-bd68-85609b6830ca tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:12.691208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9530de75-9e0e-4f68-bd68-85609b6830ca tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:12.691906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9530de75-9e0e-4f68-bd68-85609b6830ca tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:12.692399 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9530de75-9e0e-4f68-bd68-85609b6830ca tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:12.692833 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9530de75-9e0e-4f68-bd68-85609b6830ca tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:12.830753 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:12.831712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:12.847306 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:12.847861 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:12.851963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:12.854363 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:12.854847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:12.855288 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:12.859542 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9530de75-9e0e-4f68-bd68-85609b6830ca tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:12.868528 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9530de75-9e0e-4f68-bd68-85609b6830ca tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.188558 Aug 10 16:56:12.869785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 135/274] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:12 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:13.045603 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:13.067565 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:13.069180 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:13.070441 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-49e0c1b8-eb44-4ba2-bce2-cdec4b787a0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.243649 Aug 10 16:56:13.071161 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 140/275] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:12 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:13.182113 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f061685-0d58-451e-91aa-faafaaefa57a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:13.183385 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f061685-0d58-451e-91aa-faafaaefa57a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:13.192897 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f061685-0d58-451e-91aa-faafaaefa57a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:13.193395 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f061685-0d58-451e-91aa-faafaaefa57a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:13.193842 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f061685-0d58-451e-91aa-faafaaefa57a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:13.194535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f061685-0d58-451e-91aa-faafaaefa57a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:13.195009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f061685-0d58-451e-91aa-faafaaefa57a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:13.195435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f061685-0d58-451e-91aa-faafaaefa57a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:13.201442 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:13.346622 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f061685-0d58-451e-91aa-faafaaefa57a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:13.354445 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f061685-0d58-451e-91aa-faafaaefa57a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.175869 Aug 10 16:56:13.354757 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 136/276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:13 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:13.700977 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-15d0c1e8-3b59-4a9f-978e-3b5a769ee58d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:13.701589 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-15d0c1e8-3b59-4a9f-978e-3b5a769ee58d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:13.707693 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15d0c1e8-3b59-4a9f-978e-3b5a769ee58d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:13.708193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15d0c1e8-3b59-4a9f-978e-3b5a769ee58d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:13.708630 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15d0c1e8-3b59-4a9f-978e-3b5a769ee58d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:13.709311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15d0c1e8-3b59-4a9f-978e-3b5a769ee58d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:13.709765 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15d0c1e8-3b59-4a9f-978e-3b5a769ee58d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:13.710186 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15d0c1e8-3b59-4a9f-978e-3b5a769ee58d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:13.833422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-15d0c1e8-3b59-4a9f-978e-3b5a769ee58d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:13.840773 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-15d0c1e8-3b59-4a9f-978e-3b5a769ee58d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.143754 Aug 10 16:56:13.841339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 141/277] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:13 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:13.890397 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b4f4712-21a6-411f-aa0c-bde4e20ac6b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:13.891005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5b4f4712-21a6-411f-aa0c-bde4e20ac6b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:13.896822 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b4f4712-21a6-411f-aa0c-bde4e20ac6b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:13.897309 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b4f4712-21a6-411f-aa0c-bde4e20ac6b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:13.897738 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b4f4712-21a6-411f-aa0c-bde4e20ac6b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:13.898419 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b4f4712-21a6-411f-aa0c-bde4e20ac6b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:13.898869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b4f4712-21a6-411f-aa0c-bde4e20ac6b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:13.899294 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b4f4712-21a6-411f-aa0c-bde4e20ac6b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:14.024134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5b4f4712-21a6-411f-aa0c-bde4e20ac6b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:14.031869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5b4f4712-21a6-411f-aa0c-bde4e20ac6b7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.145425 Aug 10 16:56:14.032454 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 137/278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:13 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:14.094307 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:14.094914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:14.100913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:14.101396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:14.101825 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:14.102515 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:14.103075 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:14.103500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:14.230731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:14.238795 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:14.240544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:14.241645 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e364ab73-415a-49b5-a2e2-c439bfa65552 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.151274 Aug 10 16:56:14.242196 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 142/279] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:14 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:14.373653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-01399034-d5b5-4ce2-993e-8573908af1e0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:14.374293 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-01399034-d5b5-4ce2-993e-8573908af1e0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:14.380609 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01399034-d5b5-4ce2-993e-8573908af1e0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:14.381099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01399034-d5b5-4ce2-993e-8573908af1e0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:14.381534 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01399034-d5b5-4ce2-993e-8573908af1e0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:14.382219 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01399034-d5b5-4ce2-993e-8573908af1e0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:14.382897 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01399034-d5b5-4ce2-993e-8573908af1e0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:14.383328 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01399034-d5b5-4ce2-993e-8573908af1e0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:14.509021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-01399034-d5b5-4ce2-993e-8573908af1e0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:14.516842 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-01399034-d5b5-4ce2-993e-8573908af1e0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.147034 Aug 10 16:56:14.517416 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 138/280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:14 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:14.861704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3e3548f8-b369-4642-b6ef-aa7d0a80b77c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:14.862238 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3e3548f8-b369-4642-b6ef-aa7d0a80b77c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:14.867989 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e3548f8-b369-4642-b6ef-aa7d0a80b77c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:14.868496 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e3548f8-b369-4642-b6ef-aa7d0a80b77c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:14.868920 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e3548f8-b369-4642-b6ef-aa7d0a80b77c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:14.869591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e3548f8-b369-4642-b6ef-aa7d0a80b77c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:14.870034 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e3548f8-b369-4642-b6ef-aa7d0a80b77c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:14.870447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e3548f8-b369-4642-b6ef-aa7d0a80b77c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:14.994858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3e3548f8-b369-4642-b6ef-aa7d0a80b77c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:15.002595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3e3548f8-b369-4642-b6ef-aa7d0a80b77c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.144773 Aug 10 16:56:15.003155 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 143/281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:14 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:15.053387 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba9218c8-db2a-4904-abe7-b6f3254f427f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:15.054003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba9218c8-db2a-4904-abe7-b6f3254f427f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:15.060341 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9218c8-db2a-4904-abe7-b6f3254f427f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:15.060829 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9218c8-db2a-4904-abe7-b6f3254f427f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:15.061268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9218c8-db2a-4904-abe7-b6f3254f427f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:15.061957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9218c8-db2a-4904-abe7-b6f3254f427f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:15.062409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9218c8-db2a-4904-abe7-b6f3254f427f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:15.062863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9218c8-db2a-4904-abe7-b6f3254f427f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:15.194609 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba9218c8-db2a-4904-abe7-b6f3254f427f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:15.201886 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba9218c8-db2a-4904-abe7-b6f3254f427f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.152309 Aug 10 16:56:15.202447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 139/282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:15 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:15.263954 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:15.264593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:15.270353 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:15.270829 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:15.271257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:15.271931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:15.272407 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:15.272824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:15.399038 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:15.407356 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:15.408889 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:15.409976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-82e37937-ab1b-43e8-988b-ea7f2aa84e6d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.149832 Aug 10 16:56:15.410533 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 144/283] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:15 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:15.536921 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-afd8784c-5583-400e-9260-994603eb5c4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:15.537554 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-afd8784c-5583-400e-9260-994603eb5c4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:15.543784 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd8784c-5583-400e-9260-994603eb5c4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:15.544292 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd8784c-5583-400e-9260-994603eb5c4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:15.544722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd8784c-5583-400e-9260-994603eb5c4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:15.545403 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd8784c-5583-400e-9260-994603eb5c4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:15.545850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd8784c-5583-400e-9260-994603eb5c4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:15.546266 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd8784c-5583-400e-9260-994603eb5c4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:15.670906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-afd8784c-5583-400e-9260-994603eb5c4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:15.678157 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-afd8784c-5583-400e-9260-994603eb5c4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.145032 Aug 10 16:56:15.678713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 140/284] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:15 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:16.023566 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-18a85698-cac9-4e8e-8d35-4b940472da72 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:16.024193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-18a85698-cac9-4e8e-8d35-4b940472da72 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:16.030679 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18a85698-cac9-4e8e-8d35-4b940472da72 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:16.031163 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18a85698-cac9-4e8e-8d35-4b940472da72 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:16.031593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18a85698-cac9-4e8e-8d35-4b940472da72 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:16.032306 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18a85698-cac9-4e8e-8d35-4b940472da72 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:16.032756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18a85698-cac9-4e8e-8d35-4b940472da72 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:16.033173 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18a85698-cac9-4e8e-8d35-4b940472da72 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:16.161292 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-18a85698-cac9-4e8e-8d35-4b940472da72 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:16.168619 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-18a85698-cac9-4e8e-8d35-4b940472da72 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.148895 Aug 10 16:56:16.169174 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 145/285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:16 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:16.222614 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd9491ae-9e24-49c1-abad-32296f537a0a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:16.223227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dd9491ae-9e24-49c1-abad-32296f537a0a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:16.229187 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9491ae-9e24-49c1-abad-32296f537a0a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:16.229670 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9491ae-9e24-49c1-abad-32296f537a0a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:16.230107 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9491ae-9e24-49c1-abad-32296f537a0a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:16.230795 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9491ae-9e24-49c1-abad-32296f537a0a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:16.231293 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9491ae-9e24-49c1-abad-32296f537a0a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:16.231716 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9491ae-9e24-49c1-abad-32296f537a0a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:16.360549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd9491ae-9e24-49c1-abad-32296f537a0a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:16.367910 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd9491ae-9e24-49c1-abad-32296f537a0a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.149132 Aug 10 16:56:16.368570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 141/286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:16 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:16.431049 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:16.431689 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:16.438158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:16.438643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:16.439079 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:16.439765 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:16.440255 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:16.440681 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:16.567322 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:16.575675 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:16.577347 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:16.578690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c24b2653-2274-4fb9-b827-4b4a75374a77 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.151163 Aug 10 16:56:16.579633 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 146/287] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:16 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:16.699125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-363984cc-0708-4488-a32f-8d0e7fcb1c64 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:16.699732 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-363984cc-0708-4488-a32f-8d0e7fcb1c64 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:16.705950 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-363984cc-0708-4488-a32f-8d0e7fcb1c64 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:16.706432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-363984cc-0708-4488-a32f-8d0e7fcb1c64 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:16.706864 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-363984cc-0708-4488-a32f-8d0e7fcb1c64 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:16.707801 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-363984cc-0708-4488-a32f-8d0e7fcb1c64 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:16.708272 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-363984cc-0708-4488-a32f-8d0e7fcb1c64 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:16.708693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-363984cc-0708-4488-a32f-8d0e7fcb1c64 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:16.836077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-363984cc-0708-4488-a32f-8d0e7fcb1c64 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:16.843343 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-363984cc-0708-4488-a32f-8d0e7fcb1c64 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.148070 Aug 10 16:56:16.843900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 142/288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:16 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:17.189450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fbfbe82b-e2c4-40e7-bf0b-0960b5b8df7f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:17.190088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fbfbe82b-e2c4-40e7-bf0b-0960b5b8df7f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:17.195813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbfbe82b-e2c4-40e7-bf0b-0960b5b8df7f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:17.196436 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbfbe82b-e2c4-40e7-bf0b-0960b5b8df7f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:17.196935 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbfbe82b-e2c4-40e7-bf0b-0960b5b8df7f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:17.197613 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbfbe82b-e2c4-40e7-bf0b-0960b5b8df7f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:17.198056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbfbe82b-e2c4-40e7-bf0b-0960b5b8df7f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:17.198473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbfbe82b-e2c4-40e7-bf0b-0960b5b8df7f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:17.335839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fbfbe82b-e2c4-40e7-bf0b-0960b5b8df7f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:17.343810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fbfbe82b-e2c4-40e7-bf0b-0960b5b8df7f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1322 microversion: 2.1 time: 0.158406 Aug 10 16:56:17.344331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 147/289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:17 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:17.389360 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ffdc520d-aca7-40e6-84c9-549288069eb5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:17.391474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ffdc520d-aca7-40e6-84c9-549288069eb5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:17.397307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffdc520d-aca7-40e6-84c9-549288069eb5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:17.397796 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffdc520d-aca7-40e6-84c9-549288069eb5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:17.398227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffdc520d-aca7-40e6-84c9-549288069eb5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:17.398931 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffdc520d-aca7-40e6-84c9-549288069eb5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:17.399410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffdc520d-aca7-40e6-84c9-549288069eb5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:17.399815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffdc520d-aca7-40e6-84c9-549288069eb5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:17.530626 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ffdc520d-aca7-40e6-84c9-549288069eb5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:17.537958 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ffdc520d-aca7-40e6-84c9-549288069eb5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.153153 Aug 10 16:56:17.538519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 143/290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:17 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:17.608764 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:17.609289 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:17.615156 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:17.615637 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:17.616068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:17.616772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:17.617221 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:17.617638 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:17.621550 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:17.743103 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:17.751507 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:17.753014 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:17.754097 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5125e708-d46d-4f57-a1ad-9d606641e1ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.149327 Aug 10 16:56:17.754650 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 148/291] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:17 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:17.864518 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d067c8e5-52e5-4f29-b02b-4297d6883cd2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:17.865198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d067c8e5-52e5-4f29-b02b-4297d6883cd2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:17.871369 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d067c8e5-52e5-4f29-b02b-4297d6883cd2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:17.871849 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d067c8e5-52e5-4f29-b02b-4297d6883cd2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:17.872341 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d067c8e5-52e5-4f29-b02b-4297d6883cd2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:17.873022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d067c8e5-52e5-4f29-b02b-4297d6883cd2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:17.873475 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d067c8e5-52e5-4f29-b02b-4297d6883cd2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:17.873893 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d067c8e5-52e5-4f29-b02b-4297d6883cd2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.007598 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d067c8e5-52e5-4f29-b02b-4297d6883cd2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:18.015100 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d067c8e5-52e5-4f29-b02b-4297d6883cd2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.154676 Aug 10 16:56:18.015683 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 144/292] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:17 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:18.365085 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0c3febdb-4476-45df-b55c-7a207ecc7de9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:18.365713 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0c3febdb-4476-45df-b55c-7a207ecc7de9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:18.375425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c3febdb-4476-45df-b55c-7a207ecc7de9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:18.375934 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c3febdb-4476-45df-b55c-7a207ecc7de9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:18.376400 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c3febdb-4476-45df-b55c-7a207ecc7de9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.377270 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c3febdb-4476-45df-b55c-7a207ecc7de9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:18.377913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c3febdb-4476-45df-b55c-7a207ecc7de9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:18.378371 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c3febdb-4476-45df-b55c-7a207ecc7de9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.517124 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-dc0bde91-204b-4cf5-8304-bd1781dbfdb8 req-f29b9aff-70b5-4679-a07b-ded6909a1c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a08fd38-1ced-4301-a089-e789299f3104", "name": "network-vif-plugged", "status": "completed", "tag": "52b5a2cd-c933-4bfa-b4b5-c66a8d99308a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:56:18.527851 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dc0bde91-204b-4cf5-8304-bd1781dbfdb8 req-f29b9aff-70b5-4679-a07b-ded6909a1c6c service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:18.528579 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dc0bde91-204b-4cf5-8304-bd1781dbfdb8 req-f29b9aff-70b5-4679-a07b-ded6909a1c6c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:18.529282 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dc0bde91-204b-4cf5-8304-bd1781dbfdb8 req-f29b9aff-70b5-4679-a07b-ded6909a1c6c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.541622 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-dc0bde91-204b-4cf5-8304-bd1781dbfdb8 req-f29b9aff-70b5-4679-a07b-ded6909a1c6c service nova] Creating event network-vif-plugged:52b5a2cd-c933-4bfa-b4b5-c66a8d99308a for instance 2a08fd38-1ced-4301-a089-e789299f3104 on hv-cinder-83602 Aug 10 16:56:18.547482 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-dc0bde91-204b-4cf5-8304-bd1781dbfdb8 req-f29b9aff-70b5-4679-a07b-ded6909a1c6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034360 Aug 10 16:56:18.548665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 145/293] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:56:18.555301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0c3febdb-4476-45df-b55c-7a207ecc7de9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:18.565337 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9ac87139-7bb5-49eb-8261-8eaf2fd37bb8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:18.566562 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9ac87139-7bb5-49eb-8261-8eaf2fd37bb8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:18.567720 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0c3febdb-4476-45df-b55c-7a207ecc7de9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1516 microversion: 2.1 time: 0.206829 Aug 10 16:56:18.569555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 149/294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:18 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:18.588942 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ac87139-7bb5-49eb-8261-8eaf2fd37bb8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:18.589444 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ac87139-7bb5-49eb-8261-8eaf2fd37bb8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:18.589941 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ac87139-7bb5-49eb-8261-8eaf2fd37bb8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.590827 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ac87139-7bb5-49eb-8261-8eaf2fd37bb8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:18.591285 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ac87139-7bb5-49eb-8261-8eaf2fd37bb8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:18.592380 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ac87139-7bb5-49eb-8261-8eaf2fd37bb8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.597344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b46e06e-b1a9-491f-bf0a-90c1611e1952 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:56:18.602721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9b46e06e-b1a9-491f-bf0a-90c1611e1952 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:18.617352 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b46e06e-b1a9-491f-bf0a-90c1611e1952 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:18.618008 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b46e06e-b1a9-491f-bf0a-90c1611e1952 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:18.619003 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b46e06e-b1a9-491f-bf0a-90c1611e1952 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.619729 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b46e06e-b1a9-491f-bf0a-90c1611e1952 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:18.620212 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b46e06e-b1a9-491f-bf0a-90c1611e1952 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:18.621527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b46e06e-b1a9-491f-bf0a-90c1611e1952 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.689242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-9b46e06e-b1a9-491f-bf0a-90c1611e1952 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lazy-loading 'flavor' on Instance uuid a47c5a69-d424-4029-aa71-d2a0375d20cf {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:56:18.751851 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ac87139-7bb5-49eb-8261-8eaf2fd37bb8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:18.760161 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9ac87139-7bb5-49eb-8261-8eaf2fd37bb8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.199407 Aug 10 16:56:18.761269 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 146/295] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:18 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:18.777299 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:18.777896 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:18.783859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:18.784566 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:18.785001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.785686 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:18.786133 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:18.786549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.814762 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9b46e06e-b1a9-491f-bf0a-90c1611e1952 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "POST /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf/action" status: 200 len: 32 microversion: 2.1 time: 0.228055 Aug 10 16:56:18.815693 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 150/296] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 16:56:18 2022] POST /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 16:56:18.825780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b57c91dd-0976-446f-887d-b7bc1fca9434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:18.826559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b57c91dd-0976-446f-887d-b7bc1fca9434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:18.833073 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b57c91dd-0976-446f-887d-b7bc1fca9434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:18.833633 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b57c91dd-0976-446f-887d-b7bc1fca9434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:18.834128 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b57c91dd-0976-446f-887d-b7bc1fca9434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.834885 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b57c91dd-0976-446f-887d-b7bc1fca9434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:18.835395 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b57c91dd-0976-446f-887d-b7bc1fca9434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:18.835995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b57c91dd-0976-446f-887d-b7bc1fca9434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:18.959305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:18.978154 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:18.979734 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:18.980982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a1a4996a-0f35-4818-b285-c0f9941b66c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.207647 Aug 10 16:56:18.992598 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 147/297] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:18 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:19.009249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b57c91dd-0976-446f-887d-b7bc1fca9434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:19.018628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b57c91dd-0976-446f-887d-b7bc1fca9434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.197432 Aug 10 16:56:19.019571 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 151/298] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:18 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:19.037330 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4d5593c8-06d3-4232-a0ea-bae9e4b61dc2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:19.037978 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d5593c8-06d3-4232-a0ea-bae9e4b61dc2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:19.044338 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d5593c8-06d3-4232-a0ea-bae9e4b61dc2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:19.045028 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d5593c8-06d3-4232-a0ea-bae9e4b61dc2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:19.045500 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d5593c8-06d3-4232-a0ea-bae9e4b61dc2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:19.046412 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d5593c8-06d3-4232-a0ea-bae9e4b61dc2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:19.047037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d5593c8-06d3-4232-a0ea-bae9e4b61dc2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:19.047515 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d5593c8-06d3-4232-a0ea-bae9e4b61dc2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:19.192631 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d5593c8-06d3-4232-a0ea-bae9e4b61dc2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:19.200485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4d5593c8-06d3-4232-a0ea-bae9e4b61dc2 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.167878 Aug 10 16:56:19.201044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 148/299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:19 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:19.781378 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dab5b3da-1fde-4c01-b487-5b1527934cd9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:19.782032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-dab5b3da-1fde-4c01-b487-5b1527934cd9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:19.788655 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dab5b3da-1fde-4c01-b487-5b1527934cd9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:19.789364 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dab5b3da-1fde-4c01-b487-5b1527934cd9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:19.789946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dab5b3da-1fde-4c01-b487-5b1527934cd9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:19.791452 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dab5b3da-1fde-4c01-b487-5b1527934cd9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:19.792367 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dab5b3da-1fde-4c01-b487-5b1527934cd9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:19.793523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dab5b3da-1fde-4c01-b487-5b1527934cd9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:19.946109 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dab5b3da-1fde-4c01-b487-5b1527934cd9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:19.954418 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-dab5b3da-1fde-4c01-b487-5b1527934cd9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.177077 Aug 10 16:56:19.954988 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 152/300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:19 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:20.011061 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:20.012567 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:20.022195 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:20.022761 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:20.023925 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:20.024717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:20.025224 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:20.025645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:20.042820 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b4645b5-5eea-462d-9184-57a76adeaf8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:20.043674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9b4645b5-5eea-462d-9184-57a76adeaf8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:20.050390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b4645b5-5eea-462d-9184-57a76adeaf8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:20.050934 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b4645b5-5eea-462d-9184-57a76adeaf8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:20.051475 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b4645b5-5eea-462d-9184-57a76adeaf8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:20.052190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b4645b5-5eea-462d-9184-57a76adeaf8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:20.052645 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b4645b5-5eea-462d-9184-57a76adeaf8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:20.053093 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b4645b5-5eea-462d-9184-57a76adeaf8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:20.165923 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:20.174367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:20.175857 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:20.176979 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ed334ebc-36cf-45e7-8caf-cbd51856a826 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1406 microversion: 2.20 time: 0.169830 Aug 10 16:56:20.177533 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 149/301] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:20 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:56:20.191827 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9b4645b5-5eea-462d-9184-57a76adeaf8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:20.202254 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9b4645b5-5eea-462d-9184-57a76adeaf8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.163961 Aug 10 16:56:20.202845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 153/302] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:20 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:20.238213 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dba675a3-36e0-472b-b184-cce24fb33f8e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:20.238911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dba675a3-36e0-472b-b184-cce24fb33f8e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:20.245581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba675a3-36e0-472b-b184-cce24fb33f8e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:20.246725 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba675a3-36e0-472b-b184-cce24fb33f8e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:20.247195 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba675a3-36e0-472b-b184-cce24fb33f8e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:20.247888 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba675a3-36e0-472b-b184-cce24fb33f8e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:20.248554 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba675a3-36e0-472b-b184-cce24fb33f8e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:20.248971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba675a3-36e0-472b-b184-cce24fb33f8e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:20.390198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dba675a3-36e0-472b-b184-cce24fb33f8e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:20.398024 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dba675a3-36e0-472b-b184-cce24fb33f8e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.166814 Aug 10 16:56:20.398580 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 150/303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:20 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:20.975809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6cdf7051-e959-4933-ac48-6f5c693ee75b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:20.976516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6cdf7051-e959-4933-ac48-6f5c693ee75b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:20.982304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6cdf7051-e959-4933-ac48-6f5c693ee75b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:20.982858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6cdf7051-e959-4933-ac48-6f5c693ee75b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:20.983285 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6cdf7051-e959-4933-ac48-6f5c693ee75b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:20.983966 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6cdf7051-e959-4933-ac48-6f5c693ee75b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:20.984433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6cdf7051-e959-4933-ac48-6f5c693ee75b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:20.984887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6cdf7051-e959-4933-ac48-6f5c693ee75b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:21.201251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:21.201939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:21.208809 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:21.209850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:21.210487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:21.211414 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:21.212064 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:21.212730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:21.227465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6cdf7051-e959-4933-ac48-6f5c693ee75b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:21.242962 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6cdf7051-e959-4933-ac48-6f5c693ee75b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1365 microversion: 2.1 time: 0.270832 Aug 10 16:56:21.244390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 154/304] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:20 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:21.263292 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c3cc6f8f-8317-4e09-aff2-666ba1d0c3f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:21.264212 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c3cc6f8f-8317-4e09-aff2-666ba1d0c3f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:21.271176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3cc6f8f-8317-4e09-aff2-666ba1d0c3f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:21.271997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3cc6f8f-8317-4e09-aff2-666ba1d0c3f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:21.272723 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3cc6f8f-8317-4e09-aff2-666ba1d0c3f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:21.277133 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3cc6f8f-8317-4e09-aff2-666ba1d0c3f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:21.277602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3cc6f8f-8317-4e09-aff2-666ba1d0c3f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:21.278579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3cc6f8f-8317-4e09-aff2-666ba1d0c3f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:21.381968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:21.405745 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:21.407371 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:21.416181 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-acf5fe33-946a-4f91-8125-a060d88d769d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1598 microversion: 2.20 time: 0.211530 Aug 10 16:56:21.416181 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 151/305] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:56:21 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1598 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:56:21.425440 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1b7729d0-5e73-4c59-bf52-9d168f06d989 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:21.426325 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1b7729d0-5e73-4c59-bf52-9d168f06d989 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:21.454018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b7729d0-5e73-4c59-bf52-9d168f06d989 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:21.454541 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b7729d0-5e73-4c59-bf52-9d168f06d989 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:21.455144 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b7729d0-5e73-4c59-bf52-9d168f06d989 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:21.456243 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b7729d0-5e73-4c59-bf52-9d168f06d989 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:21.456713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b7729d0-5e73-4c59-bf52-9d168f06d989 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:21.457304 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b7729d0-5e73-4c59-bf52-9d168f06d989 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:21.540480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c3cc6f8f-8317-4e09-aff2-666ba1d0c3f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:21.556033 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c3cc6f8f-8317-4e09-aff2-666ba1d0c3f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.310407 Aug 10 16:56:21.556646 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 155/306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:21 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:21.561643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e81901ba-cd95-49ac-9b92-416bc3b7948b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:21.562137 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e81901ba-cd95-49ac-9b92-416bc3b7948b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:21.568129 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e81901ba-cd95-49ac-9b92-416bc3b7948b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:21.569025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e81901ba-cd95-49ac-9b92-416bc3b7948b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:21.569609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e81901ba-cd95-49ac-9b92-416bc3b7948b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:21.570485 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e81901ba-cd95-49ac-9b92-416bc3b7948b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:21.571094 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e81901ba-cd95-49ac-9b92-416bc3b7948b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:21.571664 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e81901ba-cd95-49ac-9b92-416bc3b7948b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:21.628791 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1b7729d0-5e73-4c59-bf52-9d168f06d989 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:21.637700 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1b7729d0-5e73-4c59-bf52-9d168f06d989 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.217540 Aug 10 16:56:21.639991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 152/307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:21 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:21.666566 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e81901ba-cd95-49ac-9b92-416bc3b7948b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108854 Aug 10 16:56:21.667161 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 156/308] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Aug 10 16:56:21 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:56:22.267788 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b02480b-e321-4152-af32-e977bca9eb30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:22.268485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5b02480b-e321-4152-af32-e977bca9eb30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:22.275041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b02480b-e321-4152-af32-e977bca9eb30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:22.275606 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b02480b-e321-4152-af32-e977bca9eb30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:22.276117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b02480b-e321-4152-af32-e977bca9eb30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:22.276984 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b02480b-e321-4152-af32-e977bca9eb30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:22.277565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b02480b-e321-4152-af32-e977bca9eb30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:22.278217 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b02480b-e321-4152-af32-e977bca9eb30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:22.299151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:22.469618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5b02480b-e321-4152-af32-e977bca9eb30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:22.485184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5b02480b-e321-4152-af32-e977bca9eb30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1555 microversion: 2.1 time: 0.221447 Aug 10 16:56:22.501628 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 153/309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:22 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:22.508931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8dba096f-e482-4f65-bd83-9e90f430f8af tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:22.509368 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8dba096f-e482-4f65-bd83-9e90f430f8af tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:22.516031 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8dba096f-e482-4f65-bd83-9e90f430f8af tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:22.516558 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8dba096f-e482-4f65-bd83-9e90f430f8af tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:22.516991 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8dba096f-e482-4f65-bd83-9e90f430f8af tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:22.518164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8dba096f-e482-4f65-bd83-9e90f430f8af tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:22.518569 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8dba096f-e482-4f65-bd83-9e90f430f8af tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:22.519029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8dba096f-e482-4f65-bd83-9e90f430f8af tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:22.580038 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6c5e92f1-0b85-4363-8a22-b7a534ed8277 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:22.581273 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6c5e92f1-0b85-4363-8a22-b7a534ed8277 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:22.592499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5e92f1-0b85-4363-8a22-b7a534ed8277 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:22.593199 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5e92f1-0b85-4363-8a22-b7a534ed8277 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:22.593708 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5e92f1-0b85-4363-8a22-b7a534ed8277 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:22.594742 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5e92f1-0b85-4363-8a22-b7a534ed8277 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:22.595389 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5e92f1-0b85-4363-8a22-b7a534ed8277 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:22.596413 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c5e92f1-0b85-4363-8a22-b7a534ed8277 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:22.703482 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8dba096f-e482-4f65-bd83-9e90f430f8af tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198490 Aug 10 16:56:22.704519 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 157/310] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 10 16:56:22 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:56:22.711410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9009e7b0-27ac-4069-8837-f3f4a70c5a75 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:22.712643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9009e7b0-27ac-4069-8837-f3f4a70c5a75 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:22.721958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9009e7b0-27ac-4069-8837-f3f4a70c5a75 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:22.722651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9009e7b0-27ac-4069-8837-f3f4a70c5a75 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:22.725255 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9009e7b0-27ac-4069-8837-f3f4a70c5a75 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:22.726474 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9009e7b0-27ac-4069-8837-f3f4a70c5a75 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:22.727231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9009e7b0-27ac-4069-8837-f3f4a70c5a75 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:22.727809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9009e7b0-27ac-4069-8837-f3f4a70c5a75 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:22.758521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6c5e92f1-0b85-4363-8a22-b7a534ed8277 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:22.767988 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6c5e92f1-0b85-4363-8a22-b7a534ed8277 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.192550 Aug 10 16:56:22.768731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 154/311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:22 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:23.197392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9009e7b0-27ac-4069-8837-f3f4a70c5a75 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:23.205941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9009e7b0-27ac-4069-8837-f3f4a70c5a75 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.500241 Aug 10 16:56:23.206601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 158/312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:22 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:23.789915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac30afc5-142c-4e55-bfdf-c7610395e8a4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:23.790735 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ac30afc5-142c-4e55-bfdf-c7610395e8a4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:23.806432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac30afc5-142c-4e55-bfdf-c7610395e8a4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:23.806432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac30afc5-142c-4e55-bfdf-c7610395e8a4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:23.806432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac30afc5-142c-4e55-bfdf-c7610395e8a4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:23.806432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac30afc5-142c-4e55-bfdf-c7610395e8a4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:23.809230 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac30afc5-142c-4e55-bfdf-c7610395e8a4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:23.820313 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac30afc5-142c-4e55-bfdf-c7610395e8a4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:24.111352 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ac30afc5-142c-4e55-bfdf-c7610395e8a4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:24.128068 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ac30afc5-142c-4e55-bfdf-c7610395e8a4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.340693 Aug 10 16:56:24.144176 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 155/313] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:23 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:24.227225 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c0510fb1-e0d0-414b-974b-28385c37bde0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:24.227967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c0510fb1-e0d0-414b-974b-28385c37bde0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:24.235964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0510fb1-e0d0-414b-974b-28385c37bde0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:24.237532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0510fb1-e0d0-414b-974b-28385c37bde0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:24.240161 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0510fb1-e0d0-414b-974b-28385c37bde0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:24.241153 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0510fb1-e0d0-414b-974b-28385c37bde0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:24.242873 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0510fb1-e0d0-414b-974b-28385c37bde0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:24.243524 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0510fb1-e0d0-414b-974b-28385c37bde0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:24.447854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-aa2d338d-018f-479a-83f5-c65d103502c7 req-49e49064-f067-4875-9bcd-d2118a4c5ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c45104f-0ee5-4fec-92ad-7937cbe53805", "tag": "da10f762-bc62-4992-aee6-1b182938963c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:56:24.463574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aa2d338d-018f-479a-83f5-c65d103502c7 req-49e49064-f067-4875-9bcd-d2118a4c5ec0 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:24.465962 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aa2d338d-018f-479a-83f5-c65d103502c7 req-49e49064-f067-4875-9bcd-d2118a4c5ec0 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:24.466490 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aa2d338d-018f-479a-83f5-c65d103502c7 req-49e49064-f067-4875-9bcd-d2118a4c5ec0 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:24.492489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-aa2d338d-018f-479a-83f5-c65d103502c7 req-49e49064-f067-4875-9bcd-d2118a4c5ec0 service nova] Creating event network-changed:da10f762-bc62-4992-aee6-1b182938963c for instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 on hv-cinder-83602 Aug 10 16:56:24.500613 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-aa2d338d-018f-479a-83f5-c65d103502c7 req-49e49064-f067-4875-9bcd-d2118a4c5ec0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056671 Aug 10 16:56:24.506383 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 156/314] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:56:24.586514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c0510fb1-e0d0-414b-974b-28385c37bde0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:24.638678 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c0510fb1-e0d0-414b-974b-28385c37bde0 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.412973 Aug 10 16:56:24.656838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 159/315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:24 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:25.153622 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c819f1c-986e-4722-96b3-9fea053c2bdf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:25.155200 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c819f1c-986e-4722-96b3-9fea053c2bdf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:25.162945 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c819f1c-986e-4722-96b3-9fea053c2bdf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:25.163634 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c819f1c-986e-4722-96b3-9fea053c2bdf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:25.164767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c819f1c-986e-4722-96b3-9fea053c2bdf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:25.165733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c819f1c-986e-4722-96b3-9fea053c2bdf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:25.166357 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c819f1c-986e-4722-96b3-9fea053c2bdf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:25.167081 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c819f1c-986e-4722-96b3-9fea053c2bdf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:25.440831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c819f1c-986e-4722-96b3-9fea053c2bdf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:25.454369 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c819f1c-986e-4722-96b3-9fea053c2bdf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.306672 Aug 10 16:56:25.468190 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 157/316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:25 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:25.686919 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e22d330e-b333-4275-a93c-6cfc1cf29d34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:25.687701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e22d330e-b333-4275-a93c-6cfc1cf29d34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:25.694067 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e22d330e-b333-4275-a93c-6cfc1cf29d34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:25.694555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e22d330e-b333-4275-a93c-6cfc1cf29d34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:25.695175 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e22d330e-b333-4275-a93c-6cfc1cf29d34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:25.695877 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e22d330e-b333-4275-a93c-6cfc1cf29d34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:25.697759 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e22d330e-b333-4275-a93c-6cfc1cf29d34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:25.698380 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e22d330e-b333-4275-a93c-6cfc1cf29d34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:25.904346 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e22d330e-b333-4275-a93c-6cfc1cf29d34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:25.924039 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e22d330e-b333-4275-a93c-6cfc1cf29d34 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1362 microversion: 2.1 time: 0.249446 Aug 10 16:56:25.928955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 160/317] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:25 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:26.476594 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fb1cf6c2-0f44-467a-bf72-4eb82b9fe29c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:26.477360 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fb1cf6c2-0f44-467a-bf72-4eb82b9fe29c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:26.487914 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1cf6c2-0f44-467a-bf72-4eb82b9fe29c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:26.489164 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1cf6c2-0f44-467a-bf72-4eb82b9fe29c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:26.490140 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1cf6c2-0f44-467a-bf72-4eb82b9fe29c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:26.491427 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1cf6c2-0f44-467a-bf72-4eb82b9fe29c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:26.492123 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1cf6c2-0f44-467a-bf72-4eb82b9fe29c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:26.494174 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1cf6c2-0f44-467a-bf72-4eb82b9fe29c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:26.559605 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-5f8ee392-a51d-49bd-b7e8-9fb359d1ec83 req-bbea0b39-1245-41d8-a1cf-9b9a75dce1ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993a10bf-b49d-4027-b117-d167712152e0", "tag": "0a60f022-b759-4dc7-8144-208e6c5d1ad3"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:56:26.577982 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5f8ee392-a51d-49bd-b7e8-9fb359d1ec83 req-bbea0b39-1245-41d8-a1cf-9b9a75dce1ce service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:26.578826 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5f8ee392-a51d-49bd-b7e8-9fb359d1ec83 req-bbea0b39-1245-41d8-a1cf-9b9a75dce1ce service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:26.579672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5f8ee392-a51d-49bd-b7e8-9fb359d1ec83 req-bbea0b39-1245-41d8-a1cf-9b9a75dce1ce service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:26.596619 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-5f8ee392-a51d-49bd-b7e8-9fb359d1ec83 req-bbea0b39-1245-41d8-a1cf-9b9a75dce1ce service nova] Creating event network-changed:0a60f022-b759-4dc7-8144-208e6c5d1ad3 for instance 993a10bf-b49d-4027-b117-d167712152e0 on hv-cinder-83602 Aug 10 16:56:26.604977 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-5f8ee392-a51d-49bd-b7e8-9fb359d1ec83 req-bbea0b39-1245-41d8-a1cf-9b9a75dce1ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050891 Aug 10 16:56:26.606608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 161/318] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:56:26.829367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-fb1cf6c2-0f44-467a-bf72-4eb82b9fe29c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:26.845762 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fb1cf6c2-0f44-467a-bf72-4eb82b9fe29c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.372472 Aug 10 16:56:26.847645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 158/319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:26 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:26.948490 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b0e36f4b-71ac-47e4-a957-652d48c2cd42 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:26.949836 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b0e36f4b-71ac-47e4-a957-652d48c2cd42 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:26.972202 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0e36f4b-71ac-47e4-a957-652d48c2cd42 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:26.973383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0e36f4b-71ac-47e4-a957-652d48c2cd42 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:26.974769 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0e36f4b-71ac-47e4-a957-652d48c2cd42 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:26.975858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0e36f4b-71ac-47e4-a957-652d48c2cd42 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:26.977440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0e36f4b-71ac-47e4-a957-652d48c2cd42 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:26.978118 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0e36f4b-71ac-47e4-a957-652d48c2cd42 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:27.137309 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cd8ff445-1679-483a-bdd1-ea4a5874c466 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:27.137863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cd8ff445-1679-483a-bdd1-ea4a5874c466 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:27.143994 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd8ff445-1679-483a-bdd1-ea4a5874c466 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:27.144519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd8ff445-1679-483a-bdd1-ea4a5874c466 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:27.144958 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd8ff445-1679-483a-bdd1-ea4a5874c466 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:27.145790 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd8ff445-1679-483a-bdd1-ea4a5874c466 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:27.146173 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd8ff445-1679-483a-bdd1-ea4a5874c466 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:27.146646 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd8ff445-1679-483a-bdd1-ea4a5874c466 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:27.197078 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cd8ff445-1679-483a-bdd1-ea4a5874c466 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 16:56:27.217200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b0e36f4b-71ac-47e4-a957-652d48c2cd42 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:27.228412 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b0e36f4b-71ac-47e4-a957-652d48c2cd42 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1549 microversion: 2.1 time: 0.286156 Aug 10 16:56:27.228988 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 162/320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:26 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1549 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:27.251387 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d2015520-47d4-4bb5-9275-29e72a34ecfd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:27.251387 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d2015520-47d4-4bb5-9275-29e72a34ecfd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:27.261818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2015520-47d4-4bb5-9275-29e72a34ecfd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:27.267201 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2015520-47d4-4bb5-9275-29e72a34ecfd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:27.267983 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2015520-47d4-4bb5-9275-29e72a34ecfd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:27.268758 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2015520-47d4-4bb5-9275-29e72a34ecfd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:27.269225 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2015520-47d4-4bb5-9275-29e72a34ecfd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:27.269657 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2015520-47d4-4bb5-9275-29e72a34ecfd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:27.349515 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cd8ff445-1679-483a-bdd1-ea4a5874c466 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 204 len: 0 microversion: 2.1 time: 0.216206 Aug 10 16:56:27.354346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 159/321] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 16:56:27 2022] DELETE /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 16:56:27.361651 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-385324de-0dbd-450f-b630-7ecdb7195f65 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:27.362462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-385324de-0dbd-450f-b630-7ecdb7195f65 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:27.370645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-385324de-0dbd-450f-b630-7ecdb7195f65 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:27.372396 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-385324de-0dbd-450f-b630-7ecdb7195f65 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:27.373130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-385324de-0dbd-450f-b630-7ecdb7195f65 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:27.373922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-385324de-0dbd-450f-b630-7ecdb7195f65 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:27.374845 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-385324de-0dbd-450f-b630-7ecdb7195f65 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:27.375540 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-385324de-0dbd-450f-b630-7ecdb7195f65 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:27.397797 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d2015520-47d4-4bb5-9275-29e72a34ecfd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151841 Aug 10 16:56:27.399108 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 163/322] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 10 16:56:27 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:56:27.738994 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-385324de-0dbd-450f-b630-7ecdb7195f65 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:27.752953 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-385324de-0dbd-450f-b630-7ecdb7195f65 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1553 microversion: 2.1 time: 0.396560 Aug 10 16:56:27.754698 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 160/323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:27 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1553 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:27.867773 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1eadf63d-b5ed-48ae-ba66-f66077ca7df5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:27.868406 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1eadf63d-b5ed-48ae-ba66-f66077ca7df5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:27.878810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1eadf63d-b5ed-48ae-ba66-f66077ca7df5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:27.879302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1eadf63d-b5ed-48ae-ba66-f66077ca7df5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:27.879733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1eadf63d-b5ed-48ae-ba66-f66077ca7df5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:27.880459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1eadf63d-b5ed-48ae-ba66-f66077ca7df5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:27.880909 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1eadf63d-b5ed-48ae-ba66-f66077ca7df5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:27.881327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1eadf63d-b5ed-48ae-ba66-f66077ca7df5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:28.104520 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:28.335229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1eadf63d-b5ed-48ae-ba66-f66077ca7df5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:28.350925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1eadf63d-b5ed-48ae-ba66-f66077ca7df5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.486817 Aug 10 16:56:28.353418 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 164/324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:27 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:28.777625 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6c666df-4171-423f-9eb6-6b6f44061a0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:28.778195 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a6c666df-4171-423f-9eb6-6b6f44061a0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:28.786947 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6c666df-4171-423f-9eb6-6b6f44061a0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:28.787525 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6c666df-4171-423f-9eb6-6b6f44061a0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:28.788245 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6c666df-4171-423f-9eb6-6b6f44061a0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:28.789349 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6c666df-4171-423f-9eb6-6b6f44061a0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:28.790274 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6c666df-4171-423f-9eb6-6b6f44061a0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:28.790912 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6c666df-4171-423f-9eb6-6b6f44061a0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:29.054393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6c666df-4171-423f-9eb6-6b6f44061a0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:29.066716 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6c666df-4171-423f-9eb6-6b6f44061a0b tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1553 microversion: 2.1 time: 0.295541 Aug 10 16:56:29.083258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 161/325] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:28 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1553 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:29.307605 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-eb392d23-54b1-41eb-91c8-f869003f7fcb req-011f39de-ef51-42e9-a80d-533902b7c2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a08fd38-1ced-4301-a089-e789299f3104", "tag": "52b5a2cd-c933-4bfa-b4b5-c66a8d99308a"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:56:29.324255 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-eb392d23-54b1-41eb-91c8-f869003f7fcb req-011f39de-ef51-42e9-a80d-533902b7c2b3 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:29.325610 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-eb392d23-54b1-41eb-91c8-f869003f7fcb req-011f39de-ef51-42e9-a80d-533902b7c2b3 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:29.326732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-eb392d23-54b1-41eb-91c8-f869003f7fcb req-011f39de-ef51-42e9-a80d-533902b7c2b3 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:29.345716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-eb392d23-54b1-41eb-91c8-f869003f7fcb req-011f39de-ef51-42e9-a80d-533902b7c2b3 service nova] Creating event network-changed:52b5a2cd-c933-4bfa-b4b5-c66a8d99308a for instance 2a08fd38-1ced-4301-a089-e789299f3104 on hv-cinder-83602 Aug 10 16:56:29.353227 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-eb392d23-54b1-41eb-91c8-f869003f7fcb req-011f39de-ef51-42e9-a80d-533902b7c2b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050026 Aug 10 16:56:29.354168 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 165/326] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:56:29.374365 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50e08891-676a-413d-93fd-924e21455a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:29.375170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50e08891-676a-413d-93fd-924e21455a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:29.382046 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50e08891-676a-413d-93fd-924e21455a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:29.383211 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50e08891-676a-413d-93fd-924e21455a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:29.383822 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50e08891-676a-413d-93fd-924e21455a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:29.384733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50e08891-676a-413d-93fd-924e21455a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:29.385339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50e08891-676a-413d-93fd-924e21455a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:29.386033 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50e08891-676a-413d-93fd-924e21455a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:29.534433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-50e08891-676a-413d-93fd-924e21455a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:29.544217 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-50e08891-676a-413d-93fd-924e21455a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.174095 Aug 10 16:56:29.556742 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 162/327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:29 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:30.091537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-65fab810-ac21-44b1-9b79-616bb14c9c55 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:30.092534 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-65fab810-ac21-44b1-9b79-616bb14c9c55 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:30.106265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65fab810-ac21-44b1-9b79-616bb14c9c55 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:30.106777 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65fab810-ac21-44b1-9b79-616bb14c9c55 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:30.107190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65fab810-ac21-44b1-9b79-616bb14c9c55 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:30.107886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65fab810-ac21-44b1-9b79-616bb14c9c55 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:30.108365 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65fab810-ac21-44b1-9b79-616bb14c9c55 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:30.121413 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65fab810-ac21-44b1-9b79-616bb14c9c55 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:30.470826 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-65fab810-ac21-44b1-9b79-616bb14c9c55 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:30.480317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-65fab810-ac21-44b1-9b79-616bb14c9c55 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1553 microversion: 2.1 time: 0.392540 Aug 10 16:56:30.483945 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 166/328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:30 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1553 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:30.567205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c69504c7-3657-4db6-b0b4-9e8ab61ee18e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:30.567897 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c69504c7-3657-4db6-b0b4-9e8ab61ee18e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:30.584955 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c69504c7-3657-4db6-b0b4-9e8ab61ee18e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:30.585456 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c69504c7-3657-4db6-b0b4-9e8ab61ee18e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:30.585892 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c69504c7-3657-4db6-b0b4-9e8ab61ee18e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:30.586615 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c69504c7-3657-4db6-b0b4-9e8ab61ee18e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:30.587071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c69504c7-3657-4db6-b0b4-9e8ab61ee18e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:30.587499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c69504c7-3657-4db6-b0b4-9e8ab61ee18e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:30.945025 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c69504c7-3657-4db6-b0b4-9e8ab61ee18e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:30.959346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c69504c7-3657-4db6-b0b4-9e8ab61ee18e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.395837 Aug 10 16:56:30.960022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 163/329] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:30 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:31.510038 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1f7eca6c-8281-427f-ae63-466f84fdbfd0 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:31.511873 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1f7eca6c-8281-427f-ae63-466f84fdbfd0 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:31.520104 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f7eca6c-8281-427f-ae63-466f84fdbfd0 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:31.526585 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f7eca6c-8281-427f-ae63-466f84fdbfd0 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:31.527302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f7eca6c-8281-427f-ae63-466f84fdbfd0 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:31.528685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f7eca6c-8281-427f-ae63-466f84fdbfd0 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:31.531167 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f7eca6c-8281-427f-ae63-466f84fdbfd0 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:31.531952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f7eca6c-8281-427f-ae63-466f84fdbfd0 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:31.890067 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1f7eca6c-8281-427f-ae63-466f84fdbfd0 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:31.897833 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1f7eca6c-8281-427f-ae63-466f84fdbfd0 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1553 microversion: 2.1 time: 0.395483 Aug 10 16:56:31.898396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 167/330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:31 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1553 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:31.981040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b4ad6a2-257f-4310-94ab-83d7cecffbca tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:31.981819 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9b4ad6a2-257f-4310-94ab-83d7cecffbca tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:31.988542 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b4ad6a2-257f-4310-94ab-83d7cecffbca tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:31.989040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b4ad6a2-257f-4310-94ab-83d7cecffbca tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:31.989472 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b4ad6a2-257f-4310-94ab-83d7cecffbca tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:31.990171 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b4ad6a2-257f-4310-94ab-83d7cecffbca tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:31.990625 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b4ad6a2-257f-4310-94ab-83d7cecffbca tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:31.991205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b4ad6a2-257f-4310-94ab-83d7cecffbca tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:32.126561 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-66fb3460-df8b-414f-9eb9-dacbfe944584 req-d7c517fd-2c03-465a-ba9c-f1f50b69ee16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e14798-1b43-4a9b-8ff3-70943ce0e43d", "name": "network-vif-deleted", "tag": "e5aaffe6-9f88-4d4e-b636-16032e55f1d3"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:56:32.136818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-66fb3460-df8b-414f-9eb9-dacbfe944584 req-d7c517fd-2c03-465a-ba9c-f1f50b69ee16 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:32.137275 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-66fb3460-df8b-414f-9eb9-dacbfe944584 req-d7c517fd-2c03-465a-ba9c-f1f50b69ee16 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:32.137932 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-66fb3460-df8b-414f-9eb9-dacbfe944584 req-d7c517fd-2c03-465a-ba9c-f1f50b69ee16 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:32.149627 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-66fb3460-df8b-414f-9eb9-dacbfe944584 req-d7c517fd-2c03-465a-ba9c-f1f50b69ee16 service nova] Creating event network-vif-deleted:e5aaffe6-9f88-4d4e-b636-16032e55f1d3 for instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d on hv-cinder-83602 Aug 10 16:56:32.158012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-66fb3460-df8b-414f-9eb9-dacbfe944584 req-d7c517fd-2c03-465a-ba9c-f1f50b69ee16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034992 Aug 10 16:56:32.159459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 168/331] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:56:32.170441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b4ad6a2-257f-4310-94ab-83d7cecffbca tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:32.182277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b4ad6a2-257f-4310-94ab-83d7cecffbca tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.205695 Aug 10 16:56:32.183539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 164/332] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:31 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:32.919276 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-60bfcad3-e934-462f-9109-130a45443f78 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:32.920097 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-60bfcad3-e934-462f-9109-130a45443f78 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:32.926228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60bfcad3-e934-462f-9109-130a45443f78 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:32.926710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60bfcad3-e934-462f-9109-130a45443f78 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:32.927142 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60bfcad3-e934-462f-9109-130a45443f78 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:32.927833 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60bfcad3-e934-462f-9109-130a45443f78 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:32.928318 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60bfcad3-e934-462f-9109-130a45443f78 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:32.928803 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60bfcad3-e934-462f-9109-130a45443f78 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:32.993510 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-60bfcad3-e934-462f-9109-130a45443f78 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:33.001346 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-60bfcad3-e934-462f-9109-130a45443f78 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1345 microversion: 2.1 time: 0.086389 Aug 10 16:56:33.001902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 169/333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:32 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:33.205611 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7fa9d04c-fb3a-4d54-a76a-4f15e0d9ae16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:33.206341 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7fa9d04c-fb3a-4d54-a76a-4f15e0d9ae16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:33.215236 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa9d04c-fb3a-4d54-a76a-4f15e0d9ae16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:33.215719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa9d04c-fb3a-4d54-a76a-4f15e0d9ae16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:33.216170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa9d04c-fb3a-4d54-a76a-4f15e0d9ae16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:33.216912 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa9d04c-fb3a-4d54-a76a-4f15e0d9ae16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:33.217362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa9d04c-fb3a-4d54-a76a-4f15e0d9ae16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:33.217785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa9d04c-fb3a-4d54-a76a-4f15e0d9ae16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:33.495111 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7fa9d04c-fb3a-4d54-a76a-4f15e0d9ae16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:33.503002 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7fa9d04c-fb3a-4d54-a76a-4f15e0d9ae16 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.302497 Aug 10 16:56:33.503550 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 165/334] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:33 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:34.021746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:34.022633 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:34.028348 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:34.028909 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:34.029412 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:34.030169 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:34.030677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:34.031311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:34.068393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:34.069064 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:34.069491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:34.070044 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lazy-loading 'fault' on Instance uuid 73e14798-1b43-4a9b-8ff3-70943ce0e43d {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:56:34.120033 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6677b89e26a94e5da074431e11e12050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25eeef036a7e44b0b5ee4d989f7ec507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:34.128556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-487a59a5-caff-4286-8570-7407b0f0f4fe tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 200 len: 1304 microversion: 2.1 time: 0.110678 Aug 10 16:56:34.129283 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 170/335] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:34 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:34.524196 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4a3a72d-245d-457e-bc27-2173b9af755f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:34.524742 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4a3a72d-245d-457e-bc27-2173b9af755f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:34.531555 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4a3a72d-245d-457e-bc27-2173b9af755f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:34.532045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4a3a72d-245d-457e-bc27-2173b9af755f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:34.532521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4a3a72d-245d-457e-bc27-2173b9af755f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:34.533212 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4a3a72d-245d-457e-bc27-2173b9af755f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:34.533671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4a3a72d-245d-457e-bc27-2173b9af755f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:34.534098 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4a3a72d-245d-457e-bc27-2173b9af755f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:34.664550 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4a3a72d-245d-457e-bc27-2173b9af755f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:34.671920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4a3a72d-245d-457e-bc27-2173b9af755f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.151638 Aug 10 16:56:34.672507 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 166/336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:34 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:35.149077 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:35.149597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:35.155596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:35.156291 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:35.156554 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:35.157245 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:35.157692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:35.158108 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:35.172675 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] HTTP exception thrown: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Request method failure captured: Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d HTTP/1.1 Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LdUenL5IsLELrS7FhyjDfRrU1U4AU1xkd5sNCXjtCPRbaBvm54yXP2UphBsALuVCBlMTHBYk6ayDS-CRVwigvNgkE-_w6gTDaksVpto5Fwn9UAJrU4amADOB3rl07ifIFR56vYl9pbu9lzXZEjgH4KPKBMOmRUPyKlOAbVPLjq-Bs Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 25eeef036a7e44b0b5ee4d989f7ec507 Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:56:35.177172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25eeef036a7e44b0b5ee4d989f7ec507", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 25eeef036a7e44b0b5ee4d989f7ec507 Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-DeleteServersTestJSON-878420482-project Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 6677b89e26a94e5da074431e11e12050 Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-DeleteServersTestJSON-878420482-project Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:35.178618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '73e14798-1b43-4a9b-8ff3-70943ce0e43d'} Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:56:35.179505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:35.180810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:56:35.182074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Returning 404 to user: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:56:35.182074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5a361249-6fac-49f1-9ec3-425e76d79f6c tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 404 len: 111 microversion: 2.1 time: 0.033619 Aug 10 16:56:35.182074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 171/337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:35 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:56:35.288407 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:35.290515 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:35.296374 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:35.296842 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:35.297279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:35.297965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:35.298414 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:35.298838 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:35.311718 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] HTTP exception thrown: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Request method failure captured: Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d/os-volume_attachments HTTP/1.1 Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-LdUenL5IsLELrS7FhyjDfRrU1U4AU1xkd5sNCXjtCPRbaBvm54yXP2UphBsALuVCBlMTHBYk6ayDS-CRVwigvNgkE-_w6gTDaksVpto5Fwn9UAJrU4amADOB3rl07ifIFR56vYl9pbu9lzXZEjgH4KPKBMOmRUPyKlOAbVPLjq-Bs Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: 25eeef036a7e44b0b5ee4d989f7ec507 Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 16:56:35.316561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25eeef036a7e44b0b5ee4d989f7ec507", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: 25eeef036a7e44b0b5ee4d989f7ec507 Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-DeleteServersTestJSON-878420482-project Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 6677b89e26a94e5da074431e11e12050 Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersTestJSON-878420482-project Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:35.318018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'server_id': '73e14798-1b43-4a9b-8ff3-70943ce0e43d'} Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:56:35.318875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:35.320329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:56:35.321679 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Returning 404 to user: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:56:35.321679 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-388c0599-43ab-4f69-b4ef-386603ded02a tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033590 Aug 10 16:56:35.321679 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 167/338] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 16:56:35 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:56:35.692918 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c245b067-3a7f-47d5-930c-db3f34a60c24 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:35.693536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c245b067-3a7f-47d5-930c-db3f34a60c24 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:35.699487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c245b067-3a7f-47d5-930c-db3f34a60c24 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:35.699968 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c245b067-3a7f-47d5-930c-db3f34a60c24 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:35.700435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c245b067-3a7f-47d5-930c-db3f34a60c24 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:35.701124 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c245b067-3a7f-47d5-930c-db3f34a60c24 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:35.701578 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c245b067-3a7f-47d5-930c-db3f34a60c24 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:35.701998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c245b067-3a7f-47d5-930c-db3f34a60c24 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:35.837284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c245b067-3a7f-47d5-930c-db3f34a60c24 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:35.847020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c245b067-3a7f-47d5-930c-db3f34a60c24 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.157975 Aug 10 16:56:35.848652 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 172/339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:35 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:36.531926 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:36.532512 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:36.540627 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:36.541115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:36.541547 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:36.542255 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:36.542693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:36.543142 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:36.557121 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] HTTP exception thrown: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Request method failure captured: Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d HTTP/1.1 Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-LdUenL5IsLELrS7FhyjDfRrU1U4AU1xkd5sNCXjtCPRbaBvm54yXP2UphBsALuVCBlMTHBYk6ayDS-CRVwigvNgkE-_w6gTDaksVpto5Fwn9UAJrU4amADOB3rl07ifIFR56vYl9pbu9lzXZEjgH4KPKBMOmRUPyKlOAbVPLjq-Bs Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: 25eeef036a7e44b0b5ee4d989f7ec507 Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 16:56:36.560339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25eeef036a7e44b0b5ee4d989f7ec507", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: 25eeef036a7e44b0b5ee4d989f7ec507 Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-DeleteServersTestJSON-878420482-project Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 6677b89e26a94e5da074431e11e12050 Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersTestJSON-878420482-project Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:36.561810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '73e14798-1b43-4a9b-8ff3-70943ce0e43d'} Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:56:36.562595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:36.563684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:56:36.564815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Returning 404 to user: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:56:36.564815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4a3f5c46-3655-4664-925a-4a3a2012f4f1 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 404 len: 111 microversion: 2.1 time: 0.034196 Aug 10 16:56:36.564815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 168/340] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 16:56:36 2022] DELETE /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:56:36.571182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:36.571780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] [instance: 73e14798-1b43-4a9b-8ff3-70943ce0e43d] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:36.578832 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:36.579416 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:36.579923 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:36.580755 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:36.581349 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:36.581842 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:36.595616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] HTTP exception thrown: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Request method failure captured: Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d HTTP/1.1 Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LdUenL5IsLELrS7FhyjDfRrU1U4AU1xkd5sNCXjtCPRbaBvm54yXP2UphBsALuVCBlMTHBYk6ayDS-CRVwigvNgkE-_w6gTDaksVpto5Fwn9UAJrU4amADOB3rl07ifIFR56vYl9pbu9lzXZEjgH4KPKBMOmRUPyKlOAbVPLjq-Bs Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 25eeef036a7e44b0b5ee4d989f7ec507 Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:56:36.597362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25eeef036a7e44b0b5ee4d989f7ec507", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25eeef036a7e44b0b5ee4d989f7ec507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 25eeef036a7e44b0b5ee4d989f7ec507 Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-DeleteServersTestJSON-878420482 Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-DeleteServersTestJSON-878420482-project Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 6677b89e26a94e5da074431e11e12050 Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-DeleteServersTestJSON-878420482-project Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:36.598775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '73e14798-1b43-4a9b-8ff3-70943ce0e43d'} Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:56:36.599529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. Aug 10 16:56:36.600964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:56:36.602039 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] Returning 404 to user: Instance 73e14798-1b43-4a9b-8ff3-70943ce0e43d could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:56:36.602039 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-eee51fa6-3f0a-49a0-ac69-088e89994803 tempest-DeleteServersTestJSON-878420482 tempest-DeleteServersTestJSON-878420482-project] 10.222.0.25 "GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d" status: 404 len: 111 microversion: 2.1 time: 0.033544 Aug 10 16:56:36.602039 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 173/341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:36 2022] GET /compute/v2.1/servers/73e14798-1b43-4a9b-8ff3-70943ce0e43d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:56:36.869189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc2f2b7d-e8b7-4185-a316-4095e419928b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:36.870177 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bc2f2b7d-e8b7-4185-a316-4095e419928b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:36.876911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc2f2b7d-e8b7-4185-a316-4095e419928b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:36.877548 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc2f2b7d-e8b7-4185-a316-4095e419928b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:36.877888 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc2f2b7d-e8b7-4185-a316-4095e419928b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:36.878581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc2f2b7d-e8b7-4185-a316-4095e419928b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:36.879148 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc2f2b7d-e8b7-4185-a316-4095e419928b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:36.879585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc2f2b7d-e8b7-4185-a316-4095e419928b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:37.062752 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc2f2b7d-e8b7-4185-a316-4095e419928b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:37.072011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bc2f2b7d-e8b7-4185-a316-4095e419928b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.207198 Aug 10 16:56:37.072605 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 169/342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:36 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:38.094168 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a6a3eec3-035a-4389-a82e-db23f281bfe8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:38.095552 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a6a3eec3-035a-4389-a82e-db23f281bfe8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:38.102092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6a3eec3-035a-4389-a82e-db23f281bfe8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:38.102920 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6a3eec3-035a-4389-a82e-db23f281bfe8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:38.103585 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6a3eec3-035a-4389-a82e-db23f281bfe8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:38.104651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6a3eec3-035a-4389-a82e-db23f281bfe8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:38.105304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6a3eec3-035a-4389-a82e-db23f281bfe8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:38.106508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6a3eec3-035a-4389-a82e-db23f281bfe8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:38.343213 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a6a3eec3-035a-4389-a82e-db23f281bfe8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:38.350724 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a6a3eec3-035a-4389-a82e-db23f281bfe8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.261303 Aug 10 16:56:38.351491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 174/343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:38 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:39.373396 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d3291028-21df-42e3-86a6-d0655e02a895 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:39.374570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d3291028-21df-42e3-86a6-d0655e02a895 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:39.378696 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:39.399661 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3291028-21df-42e3-86a6-d0655e02a895 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:39.399661 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3291028-21df-42e3-86a6-d0655e02a895 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:39.399661 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3291028-21df-42e3-86a6-d0655e02a895 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:39.399661 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3291028-21df-42e3-86a6-d0655e02a895 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:39.400015 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3291028-21df-42e3-86a6-d0655e02a895 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:39.400495 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3291028-21df-42e3-86a6-d0655e02a895 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:39.436722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:39.622662 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d3291028-21df-42e3-86a6-d0655e02a895 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:39.630460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d3291028-21df-42e3-86a6-d0655e02a895 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.261812 Aug 10 16:56:39.630948 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 170/344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:39 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:40.651898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4c3ff848-e0cf-4ace-bac9-510ec9510de7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:40.652568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4c3ff848-e0cf-4ace-bac9-510ec9510de7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:40.663514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=79 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:40.665100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c3ff848-e0cf-4ace-bac9-510ec9510de7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:40.665740 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c3ff848-e0cf-4ace-bac9-510ec9510de7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:40.666534 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c3ff848-e0cf-4ace-bac9-510ec9510de7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:40.667243 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c3ff848-e0cf-4ace-bac9-510ec9510de7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:40.667731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c3ff848-e0cf-4ace-bac9-510ec9510de7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:40.670006 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c3ff848-e0cf-4ace-bac9-510ec9510de7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:40.828065 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4c3ff848-e0cf-4ace-bac9-510ec9510de7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:40.836834 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4c3ff848-e0cf-4ace-bac9-510ec9510de7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.189840 Aug 10 16:56:40.837555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 175/345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:40 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:41.863818 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e3524a40-fcf9-48f5-bf8c-5c2563009597 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:41.864460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e3524a40-fcf9-48f5-bf8c-5c2563009597 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:41.870240 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3524a40-fcf9-48f5-bf8c-5c2563009597 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:41.870719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3524a40-fcf9-48f5-bf8c-5c2563009597 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:41.871181 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3524a40-fcf9-48f5-bf8c-5c2563009597 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:41.871859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3524a40-fcf9-48f5-bf8c-5c2563009597 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:41.872333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3524a40-fcf9-48f5-bf8c-5c2563009597 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:41.872755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3524a40-fcf9-48f5-bf8c-5c2563009597 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:42.008264 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e3524a40-fcf9-48f5-bf8c-5c2563009597 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:42.017454 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e3524a40-fcf9-48f5-bf8c-5c2563009597 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.162882 Aug 10 16:56:42.018283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 171/346] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:41 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:43.038799 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-614e5c92-6f1c-4087-8e89-e4a6cac0ba28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:43.039399 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-614e5c92-6f1c-4087-8e89-e4a6cac0ba28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:43.046068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-614e5c92-6f1c-4087-8e89-e4a6cac0ba28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:43.046692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-614e5c92-6f1c-4087-8e89-e4a6cac0ba28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:43.047121 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-614e5c92-6f1c-4087-8e89-e4a6cac0ba28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:43.047796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-614e5c92-6f1c-4087-8e89-e4a6cac0ba28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:43.048287 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-614e5c92-6f1c-4087-8e89-e4a6cac0ba28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:43.048708 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-614e5c92-6f1c-4087-8e89-e4a6cac0ba28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:43.185796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-614e5c92-6f1c-4087-8e89-e4a6cac0ba28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:43.193211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-614e5c92-6f1c-4087-8e89-e4a6cac0ba28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.158271 Aug 10 16:56:43.193772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 176/347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:43 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:44.214073 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9218982a-cbf8-4fca-bcfd-7c1fe0d0df30 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:44.214677 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9218982a-cbf8-4fca-bcfd-7c1fe0d0df30 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:44.221328 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9218982a-cbf8-4fca-bcfd-7c1fe0d0df30 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:44.221848 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9218982a-cbf8-4fca-bcfd-7c1fe0d0df30 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:44.222287 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9218982a-cbf8-4fca-bcfd-7c1fe0d0df30 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:44.222986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9218982a-cbf8-4fca-bcfd-7c1fe0d0df30 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:44.223442 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9218982a-cbf8-4fca-bcfd-7c1fe0d0df30 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:44.223869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9218982a-cbf8-4fca-bcfd-7c1fe0d0df30 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:44.351530 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9218982a-cbf8-4fca-bcfd-7c1fe0d0df30 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:44.359277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9218982a-cbf8-4fca-bcfd-7c1fe0d0df30 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.149104 Aug 10 16:56:44.359832 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 172/348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:44 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:45.380808 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c79d8a49-15ca-41b7-8c9e-96786ebfa7c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:45.381374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c79d8a49-15ca-41b7-8c9e-96786ebfa7c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:45.387662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c79d8a49-15ca-41b7-8c9e-96786ebfa7c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:45.388133 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c79d8a49-15ca-41b7-8c9e-96786ebfa7c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:45.388583 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c79d8a49-15ca-41b7-8c9e-96786ebfa7c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:45.389258 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c79d8a49-15ca-41b7-8c9e-96786ebfa7c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:45.389699 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c79d8a49-15ca-41b7-8c9e-96786ebfa7c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:45.390123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c79d8a49-15ca-41b7-8c9e-96786ebfa7c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:45.519146 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c79d8a49-15ca-41b7-8c9e-96786ebfa7c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:45.526552 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c79d8a49-15ca-41b7-8c9e-96786ebfa7c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.149663 Aug 10 16:56:45.527132 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 177/349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:45 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:46.547509 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-877a8b50-308d-4d00-b06f-9332ee8de3a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:46.548122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-877a8b50-308d-4d00-b06f-9332ee8de3a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:46.554464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-877a8b50-308d-4d00-b06f-9332ee8de3a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:46.554967 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-877a8b50-308d-4d00-b06f-9332ee8de3a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:46.555405 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-877a8b50-308d-4d00-b06f-9332ee8de3a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:46.556102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-877a8b50-308d-4d00-b06f-9332ee8de3a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:46.556589 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-877a8b50-308d-4d00-b06f-9332ee8de3a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:46.557021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-877a8b50-308d-4d00-b06f-9332ee8de3a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:46.682042 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-877a8b50-308d-4d00-b06f-9332ee8de3a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:46.690894 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-877a8b50-308d-4d00-b06f-9332ee8de3a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.147930 Aug 10 16:56:46.691466 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 173/350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:46 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:47.712668 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-192d7c09-f3c6-4874-8c4a-25239871cfd6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:47.713273 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-192d7c09-f3c6-4874-8c4a-25239871cfd6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:47.719166 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192d7c09-f3c6-4874-8c4a-25239871cfd6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:47.719647 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192d7c09-f3c6-4874-8c4a-25239871cfd6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:47.720081 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192d7c09-f3c6-4874-8c4a-25239871cfd6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:47.720787 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192d7c09-f3c6-4874-8c4a-25239871cfd6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:47.721236 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192d7c09-f3c6-4874-8c4a-25239871cfd6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:47.721654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192d7c09-f3c6-4874-8c4a-25239871cfd6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:47.850116 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-192d7c09-f3c6-4874-8c4a-25239871cfd6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:47.857562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-192d7c09-f3c6-4874-8c4a-25239871cfd6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.148879 Aug 10 16:56:47.858116 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 178/351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:47 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:48.879447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08766f2f-e7e3-45dc-9d72-ed9f7aeabdb0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:48.880040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08766f2f-e7e3-45dc-9d72-ed9f7aeabdb0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:48.887197 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08766f2f-e7e3-45dc-9d72-ed9f7aeabdb0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:48.888095 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08766f2f-e7e3-45dc-9d72-ed9f7aeabdb0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:48.888572 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08766f2f-e7e3-45dc-9d72-ed9f7aeabdb0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:48.889268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08766f2f-e7e3-45dc-9d72-ed9f7aeabdb0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:48.889711 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08766f2f-e7e3-45dc-9d72-ed9f7aeabdb0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:48.890333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08766f2f-e7e3-45dc-9d72-ed9f7aeabdb0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:49.072328 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-08766f2f-e7e3-45dc-9d72-ed9f7aeabdb0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:49.082204 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08766f2f-e7e3-45dc-9d72-ed9f7aeabdb0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.207047 Aug 10 16:56:49.083443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 174/352] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:48 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:50.104023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-57a77c97-9e8b-4837-92a2-9bb57f57fffa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:50.104843 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-57a77c97-9e8b-4837-92a2-9bb57f57fffa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:50.111418 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a77c97-9e8b-4837-92a2-9bb57f57fffa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:50.111907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a77c97-9e8b-4837-92a2-9bb57f57fffa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:50.112391 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a77c97-9e8b-4837-92a2-9bb57f57fffa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:50.113075 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a77c97-9e8b-4837-92a2-9bb57f57fffa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:50.113523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a77c97-9e8b-4837-92a2-9bb57f57fffa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:50.114113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a77c97-9e8b-4837-92a2-9bb57f57fffa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:50.273243 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-57a77c97-9e8b-4837-92a2-9bb57f57fffa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:50.284604 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-57a77c97-9e8b-4837-92a2-9bb57f57fffa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.184379 Aug 10 16:56:50.285429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 179/353] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:50 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:51.306451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-efab9d73-193c-422d-ba71-cb062894f5a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:51.306988 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-efab9d73-193c-422d-ba71-cb062894f5a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:51.313551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efab9d73-193c-422d-ba71-cb062894f5a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:51.314044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efab9d73-193c-422d-ba71-cb062894f5a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:51.314483 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efab9d73-193c-422d-ba71-cb062894f5a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:51.315177 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efab9d73-193c-422d-ba71-cb062894f5a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:51.315641 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efab9d73-193c-422d-ba71-cb062894f5a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:51.316070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efab9d73-193c-422d-ba71-cb062894f5a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:51.448681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-efab9d73-193c-422d-ba71-cb062894f5a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:51.455987 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-efab9d73-193c-422d-ba71-cb062894f5a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.153705 Aug 10 16:56:51.456577 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 175/354] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:51 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:52.477460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3940eeea-3b76-4090-94fa-7ef7951527b5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:52.478002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3940eeea-3b76-4090-94fa-7ef7951527b5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:52.484025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3940eeea-3b76-4090-94fa-7ef7951527b5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:52.484556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3940eeea-3b76-4090-94fa-7ef7951527b5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:52.484993 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3940eeea-3b76-4090-94fa-7ef7951527b5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:52.485714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3940eeea-3b76-4090-94fa-7ef7951527b5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:52.486179 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3940eeea-3b76-4090-94fa-7ef7951527b5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:52.486602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3940eeea-3b76-4090-94fa-7ef7951527b5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:52.624792 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3940eeea-3b76-4090-94fa-7ef7951527b5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:52.633304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3940eeea-3b76-4090-94fa-7ef7951527b5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.159776 Aug 10 16:56:52.633865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 180/355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:52 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:53.655686 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-764d3654-a7e8-4680-8f8e-6cd13adba593 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:53.656325 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-764d3654-a7e8-4680-8f8e-6cd13adba593 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:53.665753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-764d3654-a7e8-4680-8f8e-6cd13adba593 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:53.666275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-764d3654-a7e8-4680-8f8e-6cd13adba593 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:53.666715 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-764d3654-a7e8-4680-8f8e-6cd13adba593 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:53.668614 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-764d3654-a7e8-4680-8f8e-6cd13adba593 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:53.669083 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-764d3654-a7e8-4680-8f8e-6cd13adba593 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:53.669512 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-764d3654-a7e8-4680-8f8e-6cd13adba593 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:53.801004 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-764d3654-a7e8-4680-8f8e-6cd13adba593 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:53.809127 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-764d3654-a7e8-4680-8f8e-6cd13adba593 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.158191 Aug 10 16:56:53.809683 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 176/356] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:53 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:54.830306 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bd704445-1fdd-47f6-9651-84cc960efdcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:54.830914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bd704445-1fdd-47f6-9651-84cc960efdcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:54.837183 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd704445-1fdd-47f6-9651-84cc960efdcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:54.837663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd704445-1fdd-47f6-9651-84cc960efdcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:54.838095 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd704445-1fdd-47f6-9651-84cc960efdcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:54.838773 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd704445-1fdd-47f6-9651-84cc960efdcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:54.839221 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd704445-1fdd-47f6-9651-84cc960efdcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:54.840232 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd704445-1fdd-47f6-9651-84cc960efdcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:54.967908 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bd704445-1fdd-47f6-9651-84cc960efdcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:54.976503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bd704445-1fdd-47f6-9651-84cc960efdcd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.149875 Aug 10 16:56:54.977567 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 181/357] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:54 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:55.998134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e9ec609d-ee76-4135-ba56-474f5cb57ccb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:55.998836 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e9ec609d-ee76-4135-ba56-474f5cb57ccb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:56.005237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9ec609d-ee76-4135-ba56-474f5cb57ccb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:56.005725 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9ec609d-ee76-4135-ba56-474f5cb57ccb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:56.006161 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9ec609d-ee76-4135-ba56-474f5cb57ccb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:56.006847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9ec609d-ee76-4135-ba56-474f5cb57ccb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:56.007296 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9ec609d-ee76-4135-ba56-474f5cb57ccb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:56.007714 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9ec609d-ee76-4135-ba56-474f5cb57ccb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:56.146580 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e9ec609d-ee76-4135-ba56-474f5cb57ccb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:56.154435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e9ec609d-ee76-4135-ba56-474f5cb57ccb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.160418 Aug 10 16:56:56.154981 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 177/358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:55 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:57.155899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-169196579", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "networks": [{"uuid": "a890585f-f9c7-4b89-b5fa-39a66c9493c1"}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:56:57.175005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bac1506b-e10b-4917-8472-eb0bba1604a8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:57.175613 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bac1506b-e10b-4917-8472-eb0bba1604a8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:57.189363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac1506b-e10b-4917-8472-eb0bba1604a8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:57.192363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac1506b-e10b-4917-8472-eb0bba1604a8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:57.195878 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac1506b-e10b-4917-8472-eb0bba1604a8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:57.196684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac1506b-e10b-4917-8472-eb0bba1604a8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:57.197153 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac1506b-e10b-4917-8472-eb0bba1604a8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:57.197588 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac1506b-e10b-4917-8472-eb0bba1604a8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:57.213601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] validate_networks() for [('a890585f-f9c7-4b89-b5fa-39a66c9493c1', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:56:57.331862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bac1506b-e10b-4917-8472-eb0bba1604a8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:57.339619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bac1506b-e10b-4917-8472-eb0bba1604a8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.168477 Aug 10 16:56:57.340214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 178/359] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:57 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:56:57.563766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:56:57.564213 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:56:57.564691 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:56:57.565107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:56:57.565523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:56:57.577174 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:57.577875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:57.578686 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:57.579512 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:57.580176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:57.580647 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:57.599234 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Getting quotas for project aa1a38abca5848b78518b882982fc1be. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:56:57.603172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Getting quotas for user 409b789be2d9402885b2498435c76286 and project aa1a38abca5848b78518b882982fc1be. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:56:57.619715 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:56:57.622886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:56:57.672749 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5f0fa5e4-48c8-4c8e-b0ca-783f4d95c777 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520780 Aug 10 16:56:57.673384 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 182/360] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:56:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 16:56:57.683948 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-400fecd3-6a90-415d-b617-e4e2619823ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:57.684596 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-400fecd3-6a90-415d-b617-e4e2619823ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:57.744415 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-400fecd3-6a90-415d-b617-e4e2619823ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:57.751372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-400fecd3-6a90-415d-b617-e4e2619823ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1218 microversion: 2.1 time: 0.071197 Aug 10 16:56:57.751930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 179/361] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:57 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:58.360062 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-06667c33-3be7-40cf-be0b-515a60439893 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:58.360721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-06667c33-3be7-40cf-be0b-515a60439893 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:58.367068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06667c33-3be7-40cf-be0b-515a60439893 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:58.367809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06667c33-3be7-40cf-be0b-515a60439893 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:58.368528 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06667c33-3be7-40cf-be0b-515a60439893 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:58.369580 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06667c33-3be7-40cf-be0b-515a60439893 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:58.370137 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06667c33-3be7-40cf-be0b-515a60439893 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:58.371218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06667c33-3be7-40cf-be0b-515a60439893 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:58.373980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=93 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:58.521913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-06667c33-3be7-40cf-be0b-515a60439893 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:58.529216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-06667c33-3be7-40cf-be0b-515a60439893 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.173205 Aug 10 16:56:58.529938 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 183/362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:58 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:58.770720 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f3b3f0e1-e65a-43ed-963c-5f13bd44ab82 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:58.771322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f3b3f0e1-e65a-43ed-963c-5f13bd44ab82 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:58.777589 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3b3f0e1-e65a-43ed-963c-5f13bd44ab82 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:58.778065 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3b3f0e1-e65a-43ed-963c-5f13bd44ab82 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:58.778495 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3b3f0e1-e65a-43ed-963c-5f13bd44ab82 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:58.779172 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3b3f0e1-e65a-43ed-963c-5f13bd44ab82 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:58.779621 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3b3f0e1-e65a-43ed-963c-5f13bd44ab82 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:58.780044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3b3f0e1-e65a-43ed-963c-5f13bd44ab82 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:58.841229 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f3b3f0e1-e65a-43ed-963c-5f13bd44ab82 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:58.848391 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f3b3f0e1-e65a-43ed-963c-5f13bd44ab82 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1270 microversion: 2.1 time: 0.081449 Aug 10 16:56:58.848944 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 180/363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:58 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:59.550869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-210e3026-41ce-47a5-a7b5-c171234193bd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:59.551555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-210e3026-41ce-47a5-a7b5-c171234193bd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:59.557678 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-210e3026-41ce-47a5-a7b5-c171234193bd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:59.558354 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-210e3026-41ce-47a5-a7b5-c171234193bd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:59.558848 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-210e3026-41ce-47a5-a7b5-c171234193bd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:59.559567 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-210e3026-41ce-47a5-a7b5-c171234193bd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:59.560125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-210e3026-41ce-47a5-a7b5-c171234193bd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:59.560600 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-210e3026-41ce-47a5-a7b5-c171234193bd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:59.743166 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-210e3026-41ce-47a5-a7b5-c171234193bd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:56:59.751238 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-210e3026-41ce-47a5-a7b5-c171234193bd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.204278 Aug 10 16:56:59.751978 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 184/364] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:59 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:56:59.868863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5be824ed-e7fe-40b9-8517-77a15fcf40d9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:56:59.869475 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5be824ed-e7fe-40b9-8517-77a15fcf40d9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:56:59.876695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5be824ed-e7fe-40b9-8517-77a15fcf40d9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:59.877181 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5be824ed-e7fe-40b9-8517-77a15fcf40d9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:59.877611 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5be824ed-e7fe-40b9-8517-77a15fcf40d9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:56:59.878305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5be824ed-e7fe-40b9-8517-77a15fcf40d9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:56:59.878752 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5be824ed-e7fe-40b9-8517-77a15fcf40d9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:56:59.879174 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5be824ed-e7fe-40b9-8517-77a15fcf40d9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:00.020667 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5be824ed-e7fe-40b9-8517-77a15fcf40d9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:00.029051 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5be824ed-e7fe-40b9-8517-77a15fcf40d9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.163920 Aug 10 16:57:00.029941 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 181/365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:56:59 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:00.682451 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-43ee2055-fb27-4b1f-818e-055c16056fa3 req-bee3e69d-d124-4ac0-90a7-5b6ca29e860a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bae55935-f47f-403d-80dc-416589153662", "tag": "8cf30755-5eee-45c2-9369-24125c482072"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:57:00.694795 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-43ee2055-fb27-4b1f-818e-055c16056fa3 req-bee3e69d-d124-4ac0-90a7-5b6ca29e860a service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:00.695559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-43ee2055-fb27-4b1f-818e-055c16056fa3 req-bee3e69d-d124-4ac0-90a7-5b6ca29e860a service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:00.696000 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-43ee2055-fb27-4b1f-818e-055c16056fa3 req-bee3e69d-d124-4ac0-90a7-5b6ca29e860a service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:00.716993 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-43ee2055-fb27-4b1f-818e-055c16056fa3 req-bee3e69d-d124-4ac0-90a7-5b6ca29e860a service nova] Creating event network-changed:8cf30755-5eee-45c2-9369-24125c482072 for instance bae55935-f47f-403d-80dc-416589153662 on hv-cinder-83602 Aug 10 16:57:00.722119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-43ee2055-fb27-4b1f-818e-055c16056fa3 req-bee3e69d-d124-4ac0-90a7-5b6ca29e860a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044053 Aug 10 16:57:00.723161 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 185/366] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:57:00.775390 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f54b537-5476-4910-8ae2-6e5474ffc42d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:00.776581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0f54b537-5476-4910-8ae2-6e5474ffc42d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:00.784709 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f54b537-5476-4910-8ae2-6e5474ffc42d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:00.785771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f54b537-5476-4910-8ae2-6e5474ffc42d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:00.786564 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f54b537-5476-4910-8ae2-6e5474ffc42d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:00.787645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f54b537-5476-4910-8ae2-6e5474ffc42d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:00.788361 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f54b537-5476-4910-8ae2-6e5474ffc42d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:00.789002 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f54b537-5476-4910-8ae2-6e5474ffc42d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:00.933062 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0f54b537-5476-4910-8ae2-6e5474ffc42d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:00.940911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f54b537-5476-4910-8ae2-6e5474ffc42d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.170545 Aug 10 16:57:00.941492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 182/367] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:00 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:01.051308 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-39a1ca0f-641b-4d05-912f-7c3280159a7e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:01.051907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-39a1ca0f-641b-4d05-912f-7c3280159a7e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:01.058279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39a1ca0f-641b-4d05-912f-7c3280159a7e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:01.058755 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39a1ca0f-641b-4d05-912f-7c3280159a7e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:01.059189 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39a1ca0f-641b-4d05-912f-7c3280159a7e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:01.059873 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39a1ca0f-641b-4d05-912f-7c3280159a7e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:01.060641 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39a1ca0f-641b-4d05-912f-7c3280159a7e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:01.061076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39a1ca0f-641b-4d05-912f-7c3280159a7e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:01.324435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-39a1ca0f-641b-4d05-912f-7c3280159a7e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:01.340246 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-39a1ca0f-641b-4d05-912f-7c3280159a7e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.293047 Aug 10 16:57:01.341643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 186/368] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:01 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:01.963142 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-715386d1-6e56-4a3a-ab67-3ff43650349f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:01.964193 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-715386d1-6e56-4a3a-ab67-3ff43650349f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:01.972247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-715386d1-6e56-4a3a-ab67-3ff43650349f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:01.972770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-715386d1-6e56-4a3a-ab67-3ff43650349f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:01.973210 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-715386d1-6e56-4a3a-ab67-3ff43650349f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:01.973913 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-715386d1-6e56-4a3a-ab67-3ff43650349f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:01.974373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-715386d1-6e56-4a3a-ab67-3ff43650349f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:01.974863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-715386d1-6e56-4a3a-ab67-3ff43650349f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:02.121821 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-715386d1-6e56-4a3a-ab67-3ff43650349f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:02.130280 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-715386d1-6e56-4a3a-ab67-3ff43650349f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.171123 Aug 10 16:57:02.130853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 183/369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:01 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:02.361649 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fa20a34d-907d-436e-9108-14f1c8ecc039 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:02.362185 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fa20a34d-907d-436e-9108-14f1c8ecc039 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:02.368136 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa20a34d-907d-436e-9108-14f1c8ecc039 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:02.368805 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa20a34d-907d-436e-9108-14f1c8ecc039 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:02.369236 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa20a34d-907d-436e-9108-14f1c8ecc039 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:02.369952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa20a34d-907d-436e-9108-14f1c8ecc039 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:02.370431 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa20a34d-907d-436e-9108-14f1c8ecc039 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:02.370851 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa20a34d-907d-436e-9108-14f1c8ecc039 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:02.506220 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fa20a34d-907d-436e-9108-14f1c8ecc039 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:02.514808 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fa20a34d-907d-436e-9108-14f1c8ecc039 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.157044 Aug 10 16:57:02.515366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 187/370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:02 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:03.150686 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa8ef7ee-7ccf-45e2-8c23-ab4b7e262187 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:03.151539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aa8ef7ee-7ccf-45e2-8c23-ab4b7e262187 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:03.158768 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8ef7ee-7ccf-45e2-8c23-ab4b7e262187 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:03.159261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8ef7ee-7ccf-45e2-8c23-ab4b7e262187 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:03.159700 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8ef7ee-7ccf-45e2-8c23-ab4b7e262187 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:03.160615 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8ef7ee-7ccf-45e2-8c23-ab4b7e262187 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:03.161245 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8ef7ee-7ccf-45e2-8c23-ab4b7e262187 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:03.161954 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8ef7ee-7ccf-45e2-8c23-ab4b7e262187 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:03.298021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa8ef7ee-7ccf-45e2-8c23-ab4b7e262187 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:03.305435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa8ef7ee-7ccf-45e2-8c23-ab4b7e262187 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.158602 Aug 10 16:57:03.306074 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 184/371] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:03 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:03.534690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fa29fc8e-31dc-4117-bbf8-5a1931b139b2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:03.535305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fa29fc8e-31dc-4117-bbf8-5a1931b139b2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:03.541448 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa29fc8e-31dc-4117-bbf8-5a1931b139b2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:03.542115 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa29fc8e-31dc-4117-bbf8-5a1931b139b2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:03.542646 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa29fc8e-31dc-4117-bbf8-5a1931b139b2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:03.543471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa29fc8e-31dc-4117-bbf8-5a1931b139b2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:03.543853 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa29fc8e-31dc-4117-bbf8-5a1931b139b2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:03.544315 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa29fc8e-31dc-4117-bbf8-5a1931b139b2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:03.691277 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fa29fc8e-31dc-4117-bbf8-5a1931b139b2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:03.701197 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fa29fc8e-31dc-4117-bbf8-5a1931b139b2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.169583 Aug 10 16:57:03.701859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 188/372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:03 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:04.327151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90b52056-21fc-4d1c-960f-bf8dbdd5723d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:04.327652 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-90b52056-21fc-4d1c-960f-bf8dbdd5723d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:04.334228 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b52056-21fc-4d1c-960f-bf8dbdd5723d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:04.334716 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b52056-21fc-4d1c-960f-bf8dbdd5723d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:04.335152 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b52056-21fc-4d1c-960f-bf8dbdd5723d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:04.335840 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b52056-21fc-4d1c-960f-bf8dbdd5723d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:04.336362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b52056-21fc-4d1c-960f-bf8dbdd5723d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:04.336929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b52056-21fc-4d1c-960f-bf8dbdd5723d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:04.464099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-90b52056-21fc-4d1c-960f-bf8dbdd5723d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:04.472726 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-90b52056-21fc-4d1c-960f-bf8dbdd5723d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.149559 Aug 10 16:57:04.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 185/373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:04 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:04.722617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bae4ceca-2242-4834-b39f-d445e1865cb8 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:04.723363 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bae4ceca-2242-4834-b39f-d445e1865cb8 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:04.729221 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bae4ceca-2242-4834-b39f-d445e1865cb8 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:04.729703 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bae4ceca-2242-4834-b39f-d445e1865cb8 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:04.730134 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bae4ceca-2242-4834-b39f-d445e1865cb8 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:04.730813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bae4ceca-2242-4834-b39f-d445e1865cb8 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:04.731306 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bae4ceca-2242-4834-b39f-d445e1865cb8 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:04.731845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bae4ceca-2242-4834-b39f-d445e1865cb8 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:04.862625 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bae4ceca-2242-4834-b39f-d445e1865cb8 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:04.870217 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bae4ceca-2242-4834-b39f-d445e1865cb8 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.151483 Aug 10 16:57:04.870903 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 189/374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:04 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:05.494574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b56ab017-495d-4dad-b2e7-2e8a5724380d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:05.495174 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b56ab017-495d-4dad-b2e7-2e8a5724380d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:05.502086 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b56ab017-495d-4dad-b2e7-2e8a5724380d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:05.502573 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b56ab017-495d-4dad-b2e7-2e8a5724380d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:05.503002 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b56ab017-495d-4dad-b2e7-2e8a5724380d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:05.503682 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b56ab017-495d-4dad-b2e7-2e8a5724380d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:05.504131 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b56ab017-495d-4dad-b2e7-2e8a5724380d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:05.504570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b56ab017-495d-4dad-b2e7-2e8a5724380d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:05.643132 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b56ab017-495d-4dad-b2e7-2e8a5724380d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:05.651302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b56ab017-495d-4dad-b2e7-2e8a5724380d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.160416 Aug 10 16:57:05.651906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 186/375] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:05 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:05.891037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cbe521da-3240-4522-b923-7fe6be08aa17 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:05.891825 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cbe521da-3240-4522-b923-7fe6be08aa17 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:05.897956 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbe521da-3240-4522-b923-7fe6be08aa17 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:05.898439 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbe521da-3240-4522-b923-7fe6be08aa17 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:05.898873 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbe521da-3240-4522-b923-7fe6be08aa17 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:05.899536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbe521da-3240-4522-b923-7fe6be08aa17 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:05.899980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbe521da-3240-4522-b923-7fe6be08aa17 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:05.900422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbe521da-3240-4522-b923-7fe6be08aa17 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:06.042026 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cbe521da-3240-4522-b923-7fe6be08aa17 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:06.050358 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cbe521da-3240-4522-b923-7fe6be08aa17 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.163568 Aug 10 16:57:06.050964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 190/376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:05 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:06.681250 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-01a07170-4363-4f42-8bc3-6c979e85b36f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:06.681867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-01a07170-4363-4f42-8bc3-6c979e85b36f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:06.689000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a07170-4363-4f42-8bc3-6c979e85b36f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:06.689670 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a07170-4363-4f42-8bc3-6c979e85b36f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:06.690276 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a07170-4363-4f42-8bc3-6c979e85b36f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:06.691139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a07170-4363-4f42-8bc3-6c979e85b36f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:06.691906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a07170-4363-4f42-8bc3-6c979e85b36f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:06.692389 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a07170-4363-4f42-8bc3-6c979e85b36f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:06.829084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-01a07170-4363-4f42-8bc3-6c979e85b36f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:06.836893 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-01a07170-4363-4f42-8bc3-6c979e85b36f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.159506 Aug 10 16:57:06.837539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 187/377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:06 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:07.072115 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cadab280-644f-440c-a6b5-541c9d4cf63e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:07.072743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cadab280-644f-440c-a6b5-541c9d4cf63e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:07.078617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cadab280-644f-440c-a6b5-541c9d4cf63e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:07.079093 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cadab280-644f-440c-a6b5-541c9d4cf63e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:07.079526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cadab280-644f-440c-a6b5-541c9d4cf63e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:07.080217 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cadab280-644f-440c-a6b5-541c9d4cf63e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:07.080982 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cadab280-644f-440c-a6b5-541c9d4cf63e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:07.081090 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cadab280-644f-440c-a6b5-541c9d4cf63e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:07.218530 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cadab280-644f-440c-a6b5-541c9d4cf63e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:07.226146 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cadab280-644f-440c-a6b5-541c9d4cf63e tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.157739 Aug 10 16:57:07.226627 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 191/378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:07 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:07.858467 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e21b2a60-c614-48ca-966e-ff76380ea006 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:07.859075 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e21b2a60-c614-48ca-966e-ff76380ea006 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:07.861429 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:07.866867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e21b2a60-c614-48ca-966e-ff76380ea006 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:07.867354 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e21b2a60-c614-48ca-966e-ff76380ea006 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:07.867789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e21b2a60-c614-48ca-966e-ff76380ea006 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:07.868504 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e21b2a60-c614-48ca-966e-ff76380ea006 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:07.868958 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e21b2a60-c614-48ca-966e-ff76380ea006 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:07.869378 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e21b2a60-c614-48ca-966e-ff76380ea006 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:07.873964 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:08.011528 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e21b2a60-c614-48ca-966e-ff76380ea006 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:08.020269 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e21b2a60-c614-48ca-966e-ff76380ea006 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.165957 Aug 10 16:57:08.027847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 188/379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:07 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:08.244117 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:08.247592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:08.254714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ca935167-eee9-4508-a477-9f495a7f7a53 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:08.255383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ca935167-eee9-4508-a477-9f495a7f7a53 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:08.271539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca935167-eee9-4508-a477-9f495a7f7a53 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:08.272031 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca935167-eee9-4508-a477-9f495a7f7a53 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:08.272500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca935167-eee9-4508-a477-9f495a7f7a53 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:08.273190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca935167-eee9-4508-a477-9f495a7f7a53 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:08.273641 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca935167-eee9-4508-a477-9f495a7f7a53 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:08.274187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca935167-eee9-4508-a477-9f495a7f7a53 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:08.455962 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ca935167-eee9-4508-a477-9f495a7f7a53 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:08.463861 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ca935167-eee9-4508-a477-9f495a7f7a53 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.220631 Aug 10 16:57:08.464471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 192/380] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:08 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:09.040227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-512a8b8b-2902-4539-b8aa-5d667fbad3b2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:09.040784 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-512a8b8b-2902-4539-b8aa-5d667fbad3b2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:09.048074 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-512a8b8b-2902-4539-b8aa-5d667fbad3b2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:09.048440 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-512a8b8b-2902-4539-b8aa-5d667fbad3b2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:09.049030 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-512a8b8b-2902-4539-b8aa-5d667fbad3b2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:09.049961 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-512a8b8b-2902-4539-b8aa-5d667fbad3b2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:09.050437 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-512a8b8b-2902-4539-b8aa-5d667fbad3b2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:09.050929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-512a8b8b-2902-4539-b8aa-5d667fbad3b2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:09.214306 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-512a8b8b-2902-4539-b8aa-5d667fbad3b2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:09.225455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-512a8b8b-2902-4539-b8aa-5d667fbad3b2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.188949 Aug 10 16:57:09.226585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 189/381] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:09 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:09.276553 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-3ecbb0eb-649e-42b7-9774-cfc176198adf req-8ed43026-2bb4-4a6f-abfa-db304acf2a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae55935-f47f-403d-80dc-416589153662", "name": "network-vif-plugged", "status": "completed", "tag": "8cf30755-5eee-45c2-9369-24125c482072"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:57:09.290849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3ecbb0eb-649e-42b7-9774-cfc176198adf req-8ed43026-2bb4-4a6f-abfa-db304acf2a2a service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:09.291408 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3ecbb0eb-649e-42b7-9774-cfc176198adf req-8ed43026-2bb4-4a6f-abfa-db304acf2a2a service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:09.292033 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3ecbb0eb-649e-42b7-9774-cfc176198adf req-8ed43026-2bb4-4a6f-abfa-db304acf2a2a service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:09.303603 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-3ecbb0eb-649e-42b7-9774-cfc176198adf req-8ed43026-2bb4-4a6f-abfa-db304acf2a2a service nova] Creating event network-vif-plugged:8cf30755-5eee-45c2-9369-24125c482072 for instance bae55935-f47f-403d-80dc-416589153662 on hv-cinder-83602 Aug 10 16:57:09.309061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-3ecbb0eb-649e-42b7-9774-cfc176198adf req-8ed43026-2bb4-4a6f-abfa-db304acf2a2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036906 Aug 10 16:57:09.310164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 193/382] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:57:09.486396 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7fa140e8-d7d7-4cbd-85e8-0e935d44ec3c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:09.487057 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7fa140e8-d7d7-4cbd-85e8-0e935d44ec3c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:09.488990 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=42 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:09.494118 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa140e8-d7d7-4cbd-85e8-0e935d44ec3c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:09.494607 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa140e8-d7d7-4cbd-85e8-0e935d44ec3c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:09.495037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa140e8-d7d7-4cbd-85e8-0e935d44ec3c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:09.495731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa140e8-d7d7-4cbd-85e8-0e935d44ec3c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:09.496206 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa140e8-d7d7-4cbd-85e8-0e935d44ec3c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:09.496631 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa140e8-d7d7-4cbd-85e8-0e935d44ec3c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:09.634347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7fa140e8-d7d7-4cbd-85e8-0e935d44ec3c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:09.642350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7fa140e8-d7d7-4cbd-85e8-0e935d44ec3c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.161045 Aug 10 16:57:09.642930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 190/383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:09 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:10.248318 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-88884528-7783-4c61-829e-d012d342311a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:10.249342 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-88884528-7783-4c61-829e-d012d342311a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:10.257629 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88884528-7783-4c61-829e-d012d342311a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:10.258624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88884528-7783-4c61-829e-d012d342311a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:10.259073 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88884528-7783-4c61-829e-d012d342311a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:10.259874 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88884528-7783-4c61-829e-d012d342311a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:10.260756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88884528-7783-4c61-829e-d012d342311a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:10.261317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88884528-7783-4c61-829e-d012d342311a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:10.534450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-88884528-7783-4c61-829e-d012d342311a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:10.541824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-88884528-7783-4c61-829e-d012d342311a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.298649 Aug 10 16:57:10.542415 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 194/384] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:10 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:10.662900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4314d461-a7ea-4e75-9ecc-0d80b5d6c8ab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:10.663507 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4314d461-a7ea-4e75-9ecc-0d80b5d6c8ab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:10.669813 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4314d461-a7ea-4e75-9ecc-0d80b5d6c8ab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:10.670235 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4314d461-a7ea-4e75-9ecc-0d80b5d6c8ab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:10.670665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4314d461-a7ea-4e75-9ecc-0d80b5d6c8ab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:10.671342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4314d461-a7ea-4e75-9ecc-0d80b5d6c8ab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:10.671793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4314d461-a7ea-4e75-9ecc-0d80b5d6c8ab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:10.672409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4314d461-a7ea-4e75-9ecc-0d80b5d6c8ab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:10.795236 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4314d461-a7ea-4e75-9ecc-0d80b5d6c8ab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:10.802655 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4314d461-a7ea-4e75-9ecc-0d80b5d6c8ab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.143536 Aug 10 16:57:10.803234 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 191/385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:10 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:11.563204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f7a127e1-4503-43dd-a36d-6536291050bb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:11.563835 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f7a127e1-4503-43dd-a36d-6536291050bb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:11.565852 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:11.571017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7a127e1-4503-43dd-a36d-6536291050bb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:11.571490 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7a127e1-4503-43dd-a36d-6536291050bb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:11.571921 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7a127e1-4503-43dd-a36d-6536291050bb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:11.572641 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7a127e1-4503-43dd-a36d-6536291050bb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:11.573086 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7a127e1-4503-43dd-a36d-6536291050bb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:11.573545 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7a127e1-4503-43dd-a36d-6536291050bb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:11.708202 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f7a127e1-4503-43dd-a36d-6536291050bb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:11.716182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f7a127e1-4503-43dd-a36d-6536291050bb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.156915 Aug 10 16:57:11.716736 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 195/386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:11 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:11.823312 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e715b94d-caec-4b05-b828-a7284ade0bf7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:11.823936 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e715b94d-caec-4b05-b828-a7284ade0bf7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:11.830669 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e715b94d-caec-4b05-b828-a7284ade0bf7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:11.831156 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e715b94d-caec-4b05-b828-a7284ade0bf7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:11.831588 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e715b94d-caec-4b05-b828-a7284ade0bf7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:11.832320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e715b94d-caec-4b05-b828-a7284ade0bf7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:11.833084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e715b94d-caec-4b05-b828-a7284ade0bf7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:11.833506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e715b94d-caec-4b05-b828-a7284ade0bf7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:11.966443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e715b94d-caec-4b05-b828-a7284ade0bf7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:11.973890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e715b94d-caec-4b05-b828-a7284ade0bf7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.154416 Aug 10 16:57:11.974455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 192/387] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:11 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:12.738454 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3781271f-a1f5-425e-9183-973125a0109d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:12.739068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3781271f-a1f5-425e-9183-973125a0109d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:12.745331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3781271f-a1f5-425e-9183-973125a0109d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:12.745850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3781271f-a1f5-425e-9183-973125a0109d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:12.746286 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3781271f-a1f5-425e-9183-973125a0109d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:12.747531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3781271f-a1f5-425e-9183-973125a0109d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:12.747947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3781271f-a1f5-425e-9183-973125a0109d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:12.748403 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3781271f-a1f5-425e-9183-973125a0109d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:12.878812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3781271f-a1f5-425e-9183-973125a0109d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:12.886579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3781271f-a1f5-425e-9183-973125a0109d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.153592 Aug 10 16:57:12.887137 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 196/388] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:12 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:12.994659 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2d38b3c8-d206-4410-aa82-b3dc81b8ed8c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:12.995268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2d38b3c8-d206-4410-aa82-b3dc81b8ed8c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:13.002191 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d38b3c8-d206-4410-aa82-b3dc81b8ed8c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:13.002840 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d38b3c8-d206-4410-aa82-b3dc81b8ed8c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:13.003285 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d38b3c8-d206-4410-aa82-b3dc81b8ed8c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:13.004015 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d38b3c8-d206-4410-aa82-b3dc81b8ed8c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:13.004665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d38b3c8-d206-4410-aa82-b3dc81b8ed8c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:13.005090 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d38b3c8-d206-4410-aa82-b3dc81b8ed8c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:13.133611 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2d38b3c8-d206-4410-aa82-b3dc81b8ed8c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:13.141283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2d38b3c8-d206-4410-aa82-b3dc81b8ed8c tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1318 microversion: 2.1 time: 0.150389 Aug 10 16:57:13.141841 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 193/389] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:12 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:13.908295 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2d6e5c3f-bd81-4536-9567-7e4e15be33f9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:13.909051 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2d6e5c3f-bd81-4536-9567-7e4e15be33f9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:13.915491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d6e5c3f-bd81-4536-9567-7e4e15be33f9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:13.915971 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d6e5c3f-bd81-4536-9567-7e4e15be33f9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:13.916475 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d6e5c3f-bd81-4536-9567-7e4e15be33f9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:13.917123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d6e5c3f-bd81-4536-9567-7e4e15be33f9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:13.917558 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d6e5c3f-bd81-4536-9567-7e4e15be33f9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:13.924978 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d6e5c3f-bd81-4536-9567-7e4e15be33f9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:14.072639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2d6e5c3f-bd81-4536-9567-7e4e15be33f9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:14.081965 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2d6e5c3f-bd81-4536-9567-7e4e15be33f9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1522 microversion: 2.1 time: 0.177878 Aug 10 16:57:14.082522 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 197/390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:13 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:14.163016 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f3961c1-a213-4acc-92fd-f6c7891437cc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:14.163630 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8f3961c1-a213-4acc-92fd-f6c7891437cc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:14.170257 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3961c1-a213-4acc-92fd-f6c7891437cc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:14.170747 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3961c1-a213-4acc-92fd-f6c7891437cc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:14.171311 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3961c1-a213-4acc-92fd-f6c7891437cc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:14.171916 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3961c1-a213-4acc-92fd-f6c7891437cc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:14.172416 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3961c1-a213-4acc-92fd-f6c7891437cc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:14.172836 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3961c1-a213-4acc-92fd-f6c7891437cc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:14.329883 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8f3961c1-a213-4acc-92fd-f6c7891437cc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:14.337778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8f3961c1-a213-4acc-92fd-f6c7891437cc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1505 microversion: 2.1 time: 0.178945 Aug 10 16:57:14.338340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 194/391] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:14 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:15.102683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fc4ffde6-2433-4e26-ab86-b7ddb3021c31 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:15.103291 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fc4ffde6-2433-4e26-ab86-b7ddb3021c31 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:15.109379 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc4ffde6-2433-4e26-ab86-b7ddb3021c31 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:15.109858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc4ffde6-2433-4e26-ab86-b7ddb3021c31 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:15.110283 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc4ffde6-2433-4e26-ab86-b7ddb3021c31 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:15.110958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc4ffde6-2433-4e26-ab86-b7ddb3021c31 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:15.111402 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc4ffde6-2433-4e26-ab86-b7ddb3021c31 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:15.111817 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc4ffde6-2433-4e26-ab86-b7ddb3021c31 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:15.241890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fc4ffde6-2433-4e26-ab86-b7ddb3021c31 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:15.249213 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fc4ffde6-2433-4e26-ab86-b7ddb3021c31 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1502 microversion: 2.1 time: 0.150353 Aug 10 16:57:15.249794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 198/392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:15 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:15.269174 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa335af5-7dad-4f96-b0e8-d0b1cba334be tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:15.269790 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa335af5-7dad-4f96-b0e8-d0b1cba334be tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:15.276009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa335af5-7dad-4f96-b0e8-d0b1cba334be tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:15.276555 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa335af5-7dad-4f96-b0e8-d0b1cba334be tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:15.277073 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa335af5-7dad-4f96-b0e8-d0b1cba334be tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:15.278447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa335af5-7dad-4f96-b0e8-d0b1cba334be tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:15.278909 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa335af5-7dad-4f96-b0e8-d0b1cba334be tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:15.279509 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa335af5-7dad-4f96-b0e8-d0b1cba334be tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:15.411466 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa335af5-7dad-4f96-b0e8-d0b1cba334be tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:15.422101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa335af5-7dad-4f96-b0e8-d0b1cba334be tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1516 microversion: 2.1 time: 0.156627 Aug 10 16:57:15.422688 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 195/393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:15 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:17.869607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ccbcaccc-9bd5-4368-8047-94e148779805 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:57:17.872395 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ccbcaccc-9bd5-4368-8047-94e148779805 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:17.878443 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ccbcaccc-9bd5-4368-8047-94e148779805 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:17.878993 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ccbcaccc-9bd5-4368-8047-94e148779805 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:17.879512 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ccbcaccc-9bd5-4368-8047-94e148779805 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:17.880293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ccbcaccc-9bd5-4368-8047-94e148779805 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:17.880804 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ccbcaccc-9bd5-4368-8047-94e148779805 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:17.881298 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ccbcaccc-9bd5-4368-8047-94e148779805 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:17.904003 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-ccbcaccc-9bd5-4368-8047-94e148779805 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lazy-loading 'flavor' on Instance uuid cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:57:17.964101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:17.997865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ccbcaccc-9bd5-4368-8047-94e148779805 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "POST /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9/action" status: 200 len: 32 microversion: 2.1 time: 0.131360 Aug 10 16:57:17.998474 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 199/394] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 16:57:17 2022] POST /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9/action => generated 32 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 16:57:18.008381 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b6272089-1050-42e9-aeba-b46d6b6c56f2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:18.008982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b6272089-1050-42e9-aeba-b46d6b6c56f2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:18.022873 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6272089-1050-42e9-aeba-b46d6b6c56f2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:18.023876 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6272089-1050-42e9-aeba-b46d6b6c56f2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:18.024507 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6272089-1050-42e9-aeba-b46d6b6c56f2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:18.025443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6272089-1050-42e9-aeba-b46d6b6c56f2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:18.025930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6272089-1050-42e9-aeba-b46d6b6c56f2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:18.026531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6272089-1050-42e9-aeba-b46d6b6c56f2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:18.175881 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b6272089-1050-42e9-aeba-b46d6b6c56f2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:18.187763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b6272089-1050-42e9-aeba-b46d6b6c56f2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.183008 Aug 10 16:57:18.188875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 196/395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:18 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:19.214229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b918d2dd-1089-43d4-ac91-862c7bb1b11b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:19.215013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b918d2dd-1089-43d4-ac91-862c7bb1b11b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:19.221545 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b918d2dd-1089-43d4-ac91-862c7bb1b11b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:19.222173 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b918d2dd-1089-43d4-ac91-862c7bb1b11b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:19.222443 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b918d2dd-1089-43d4-ac91-862c7bb1b11b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:19.223152 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b918d2dd-1089-43d4-ac91-862c7bb1b11b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:19.223595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b918d2dd-1089-43d4-ac91-862c7bb1b11b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:19.224025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b918d2dd-1089-43d4-ac91-862c7bb1b11b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:19.369166 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b918d2dd-1089-43d4-ac91-862c7bb1b11b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:19.377025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b918d2dd-1089-43d4-ac91-862c7bb1b11b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.167045 Aug 10 16:57:19.377581 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 200/396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:19 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:20.398569 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0405179e-1033-4540-a650-e6797e75fdd4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:20.399172 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0405179e-1033-4540-a650-e6797e75fdd4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:20.414979 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0405179e-1033-4540-a650-e6797e75fdd4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:20.415683 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0405179e-1033-4540-a650-e6797e75fdd4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:20.416124 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0405179e-1033-4540-a650-e6797e75fdd4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:20.416866 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0405179e-1033-4540-a650-e6797e75fdd4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:20.417326 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0405179e-1033-4540-a650-e6797e75fdd4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:20.417754 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0405179e-1033-4540-a650-e6797e75fdd4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:20.584436 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0405179e-1033-4540-a650-e6797e75fdd4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:20.593228 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0405179e-1033-4540-a650-e6797e75fdd4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.198525 Aug 10 16:57:20.593921 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 197/397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:20 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:21.613957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2e141267-31a5-40d2-bb34-ca506ab06745 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:21.614682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2e141267-31a5-40d2-bb34-ca506ab06745 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:21.620543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2e141267-31a5-40d2-bb34-ca506ab06745 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:21.621104 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2e141267-31a5-40d2-bb34-ca506ab06745 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:21.622094 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2e141267-31a5-40d2-bb34-ca506ab06745 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:21.622777 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2e141267-31a5-40d2-bb34-ca506ab06745 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:21.623223 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2e141267-31a5-40d2-bb34-ca506ab06745 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:21.623680 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2e141267-31a5-40d2-bb34-ca506ab06745 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:21.788102 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2e141267-31a5-40d2-bb34-ca506ab06745 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:21.797989 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2e141267-31a5-40d2-bb34-ca506ab06745 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.187873 Aug 10 16:57:21.798556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 201/398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:21 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:22.818771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71db5414-2ff7-4c7d-b2ba-11837d1cb9d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:22.819488 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-71db5414-2ff7-4c7d-b2ba-11837d1cb9d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:22.826739 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71db5414-2ff7-4c7d-b2ba-11837d1cb9d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:22.827271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71db5414-2ff7-4c7d-b2ba-11837d1cb9d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:22.827826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71db5414-2ff7-4c7d-b2ba-11837d1cb9d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:22.828652 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71db5414-2ff7-4c7d-b2ba-11837d1cb9d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:22.828999 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71db5414-2ff7-4c7d-b2ba-11837d1cb9d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:22.829424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71db5414-2ff7-4c7d-b2ba-11837d1cb9d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:22.982294 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-71db5414-2ff7-4c7d-b2ba-11837d1cb9d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:22.990937 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-71db5414-2ff7-4c7d-b2ba-11837d1cb9d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.176064 Aug 10 16:57:22.993875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 198/399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:22 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:24.017559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3e9cabf3-a0cc-4942-8685-173032889cc4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:24.018167 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3e9cabf3-a0cc-4942-8685-173032889cc4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:24.024836 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e9cabf3-a0cc-4942-8685-173032889cc4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:24.024836 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e9cabf3-a0cc-4942-8685-173032889cc4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:24.025018 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e9cabf3-a0cc-4942-8685-173032889cc4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:24.025671 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e9cabf3-a0cc-4942-8685-173032889cc4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:24.026122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e9cabf3-a0cc-4942-8685-173032889cc4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:24.026664 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e9cabf3-a0cc-4942-8685-173032889cc4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:24.163778 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3e9cabf3-a0cc-4942-8685-173032889cc4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:24.171796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3e9cabf3-a0cc-4942-8685-173032889cc4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.158050 Aug 10 16:57:24.172400 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 202/400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:24 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:25.194610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b5a83a99-158f-481f-8156-2e044958c50e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:25.195935 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b5a83a99-158f-481f-8156-2e044958c50e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:25.202401 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a83a99-158f-481f-8156-2e044958c50e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:25.203128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a83a99-158f-481f-8156-2e044958c50e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:25.203569 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a83a99-158f-481f-8156-2e044958c50e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:25.204303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a83a99-158f-481f-8156-2e044958c50e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:25.204770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a83a99-158f-481f-8156-2e044958c50e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:25.205193 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a83a99-158f-481f-8156-2e044958c50e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:25.350214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b5a83a99-158f-481f-8156-2e044958c50e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:25.360510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b5a83a99-158f-481f-8156-2e044958c50e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.169523 Aug 10 16:57:25.361327 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 199/401] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:25 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:26.381741 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b542bc85-ced2-4070-801f-87ca690d5c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:26.382349 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b542bc85-ced2-4070-801f-87ca690d5c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:26.388311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b542bc85-ced2-4070-801f-87ca690d5c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:26.388801 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b542bc85-ced2-4070-801f-87ca690d5c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:26.389233 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b542bc85-ced2-4070-801f-87ca690d5c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:26.389924 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b542bc85-ced2-4070-801f-87ca690d5c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:26.390373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b542bc85-ced2-4070-801f-87ca690d5c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:26.390787 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b542bc85-ced2-4070-801f-87ca690d5c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:26.536841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b542bc85-ced2-4070-801f-87ca690d5c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:26.544929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b542bc85-ced2-4070-801f-87ca690d5c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.167007 Aug 10 16:57:26.545601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 203/402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:26 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:27.565780 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f5ac35b8-6aff-4797-9692-4a9f55231f0b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:27.566381 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f5ac35b8-6aff-4797-9692-4a9f55231f0b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:27.572734 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5ac35b8-6aff-4797-9692-4a9f55231f0b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:27.573215 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5ac35b8-6aff-4797-9692-4a9f55231f0b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:27.573646 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5ac35b8-6aff-4797-9692-4a9f55231f0b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:27.575035 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5ac35b8-6aff-4797-9692-4a9f55231f0b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:27.575495 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5ac35b8-6aff-4797-9692-4a9f55231f0b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:27.575921 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5ac35b8-6aff-4797-9692-4a9f55231f0b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:27.620845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-422718413", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "networks": [{"uuid": "dc6dd6ea-0c81-4f11-974d-bb9657470b34"}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:57:27.673009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] validate_networks() for [('dc6dd6ea-0c81-4f11-974d-bb9657470b34', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:57:27.704947 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f5ac35b8-6aff-4797-9692-4a9f55231f0b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:27.712643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f5ac35b8-6aff-4797-9692-4a9f55231f0b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.150785 Aug 10 16:57:27.713206 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 200/403] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:27 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:28.015552 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:57:28.015974 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:57:28.016479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:57:28.016886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:57:28.017291 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:57:28.025865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:28.026373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:28.026799 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:28.027514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:28.027962 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:28.028417 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:28.045677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Getting quotas for project abe3003a0c91471e9982327ac5e17b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:57:28.050080 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Getting quotas for user 5d1f341b9aff4b7db13e429b86ba145e and project abe3003a0c91471e9982327ac5e17b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:57:28.061332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:57:28.063567 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:57:28.114581 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e626bff2-5278-416f-8ec3-3a7aa8e54e64 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497485 Aug 10 16:57:28.115213 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 204/404] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 16:57:28.126447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fdc103a8-38c4-490d-bd49-49cce9b2c1e4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:28.127054 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fdc103a8-38c4-490d-bd49-49cce9b2c1e4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:28.181803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-fdc103a8-38c4-490d-bd49-49cce9b2c1e4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:28.188784 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fdc103a8-38c4-490d-bd49-49cce9b2c1e4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1213 microversion: 2.1 time: 0.066191 Aug 10 16:57:28.189430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 201/405] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:28 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:28.733437 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b3e4027c-2d85-4f92-902c-58cdf52223ff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:28.734083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b3e4027c-2d85-4f92-902c-58cdf52223ff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:28.740187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3e4027c-2d85-4f92-902c-58cdf52223ff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:28.740665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3e4027c-2d85-4f92-902c-58cdf52223ff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:28.741096 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3e4027c-2d85-4f92-902c-58cdf52223ff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:28.741774 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3e4027c-2d85-4f92-902c-58cdf52223ff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:28.742224 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3e4027c-2d85-4f92-902c-58cdf52223ff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:28.742645 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3e4027c-2d85-4f92-902c-58cdf52223ff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:28.866785 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b3e4027c-2d85-4f92-902c-58cdf52223ff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:28.874078 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b3e4027c-2d85-4f92-902c-58cdf52223ff tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.144503 Aug 10 16:57:28.874635 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 205/406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:28 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:29.209203 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1c9e764c-b41a-41d6-9ed6-a30c4761a8e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:29.209803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1c9e764c-b41a-41d6-9ed6-a30c4761a8e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:29.216023 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c9e764c-b41a-41d6-9ed6-a30c4761a8e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:29.216533 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c9e764c-b41a-41d6-9ed6-a30c4761a8e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:29.217044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c9e764c-b41a-41d6-9ed6-a30c4761a8e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:29.217722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c9e764c-b41a-41d6-9ed6-a30c4761a8e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:29.218169 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c9e764c-b41a-41d6-9ed6-a30c4761a8e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:29.218587 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c9e764c-b41a-41d6-9ed6-a30c4761a8e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:29.276802 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1c9e764c-b41a-41d6-9ed6-a30c4761a8e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:29.284070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1c9e764c-b41a-41d6-9ed6-a30c4761a8e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1217 microversion: 2.1 time: 0.078903 Aug 10 16:57:29.284666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 202/407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:29 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:29.894868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ba4b7fa2-0d72-46b0-adb8-cd7c0e8085ef tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:29.895393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ba4b7fa2-0d72-46b0-adb8-cd7c0e8085ef tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:29.901326 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba4b7fa2-0d72-46b0-adb8-cd7c0e8085ef tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:29.901813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba4b7fa2-0d72-46b0-adb8-cd7c0e8085ef tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:29.902801 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba4b7fa2-0d72-46b0-adb8-cd7c0e8085ef tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:29.903588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba4b7fa2-0d72-46b0-adb8-cd7c0e8085ef tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:29.904043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba4b7fa2-0d72-46b0-adb8-cd7c0e8085ef tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:29.904496 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba4b7fa2-0d72-46b0-adb8-cd7c0e8085ef tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:30.032990 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ba4b7fa2-0d72-46b0-adb8-cd7c0e8085ef tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:30.040281 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ba4b7fa2-0d72-46b0-adb8-cd7c0e8085ef tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.149336 Aug 10 16:57:30.040845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 206/408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:29 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:30.304755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e64e4998-733e-4478-9daa-1dbe3fdc8230 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:30.305354 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e64e4998-733e-4478-9daa-1dbe3fdc8230 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:30.311787 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64e4998-733e-4478-9daa-1dbe3fdc8230 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:30.312305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64e4998-733e-4478-9daa-1dbe3fdc8230 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:30.312735 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64e4998-733e-4478-9daa-1dbe3fdc8230 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:30.313410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64e4998-733e-4478-9daa-1dbe3fdc8230 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:30.314025 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64e4998-733e-4478-9daa-1dbe3fdc8230 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:30.314452 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64e4998-733e-4478-9daa-1dbe3fdc8230 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:30.373787 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e64e4998-733e-4478-9daa-1dbe3fdc8230 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:30.380960 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e64e4998-733e-4478-9daa-1dbe3fdc8230 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1217 microversion: 2.1 time: 0.080005 Aug 10 16:57:30.381518 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 203/409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:30 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:31.063052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-04a901fc-eaa6-43b1-8f62-57cf5dda520a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:31.063669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-04a901fc-eaa6-43b1-8f62-57cf5dda520a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:31.069545 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a901fc-eaa6-43b1-8f62-57cf5dda520a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:31.070026 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a901fc-eaa6-43b1-8f62-57cf5dda520a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:31.070460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a901fc-eaa6-43b1-8f62-57cf5dda520a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:31.071141 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a901fc-eaa6-43b1-8f62-57cf5dda520a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:31.071592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a901fc-eaa6-43b1-8f62-57cf5dda520a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:31.072014 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a901fc-eaa6-43b1-8f62-57cf5dda520a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:31.203344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-04a901fc-eaa6-43b1-8f62-57cf5dda520a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:31.210944 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-04a901fc-eaa6-43b1-8f62-57cf5dda520a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.152374 Aug 10 16:57:31.211501 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 207/410] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:31 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:31.401591 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b910e2d-7331-4cee-933b-35401e375a69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:31.402134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b910e2d-7331-4cee-933b-35401e375a69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:31.408966 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b910e2d-7331-4cee-933b-35401e375a69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:31.409454 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b910e2d-7331-4cee-933b-35401e375a69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:31.409889 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b910e2d-7331-4cee-933b-35401e375a69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:31.410586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b910e2d-7331-4cee-933b-35401e375a69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:31.411037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b910e2d-7331-4cee-933b-35401e375a69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:31.411459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b910e2d-7331-4cee-933b-35401e375a69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:31.472563 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7b910e2d-7331-4cee-933b-35401e375a69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:31.479776 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b910e2d-7331-4cee-933b-35401e375a69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1217 microversion: 2.1 time: 0.082089 Aug 10 16:57:31.480421 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 204/411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:31 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:32.232607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-afa40b60-9f6d-432b-b0ec-6e960740b5f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:32.233264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-afa40b60-9f6d-432b-b0ec-6e960740b5f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:32.239084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afa40b60-9f6d-432b-b0ec-6e960740b5f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:32.239562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afa40b60-9f6d-432b-b0ec-6e960740b5f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:32.239994 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afa40b60-9f6d-432b-b0ec-6e960740b5f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:32.240702 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afa40b60-9f6d-432b-b0ec-6e960740b5f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:32.241148 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afa40b60-9f6d-432b-b0ec-6e960740b5f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:32.241568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afa40b60-9f6d-432b-b0ec-6e960740b5f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:32.369234 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-afa40b60-9f6d-432b-b0ec-6e960740b5f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:32.377062 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-afa40b60-9f6d-432b-b0ec-6e960740b5f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.148859 Aug 10 16:57:32.377615 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 208/412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:32 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:32.501543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ce1939d-aa6d-49ff-8707-c79dd1ebc371 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:32.502090 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ce1939d-aa6d-49ff-8707-c79dd1ebc371 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:32.508410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce1939d-aa6d-49ff-8707-c79dd1ebc371 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:32.508898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce1939d-aa6d-49ff-8707-c79dd1ebc371 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:32.509328 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce1939d-aa6d-49ff-8707-c79dd1ebc371 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:32.510009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce1939d-aa6d-49ff-8707-c79dd1ebc371 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:32.510463 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce1939d-aa6d-49ff-8707-c79dd1ebc371 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:32.510890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce1939d-aa6d-49ff-8707-c79dd1ebc371 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:32.570363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6ce1939d-aa6d-49ff-8707-c79dd1ebc371 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:32.573671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:32.578489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ce1939d-aa6d-49ff-8707-c79dd1ebc371 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1217 microversion: 2.1 time: 0.081561 Aug 10 16:57:32.579052 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 205/413] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:32 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:33.397807 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d29269b6-03ba-4bc3-8fee-a5c3e228124d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:33.398422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d29269b6-03ba-4bc3-8fee-a5c3e228124d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:33.404805 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29269b6-03ba-4bc3-8fee-a5c3e228124d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:33.405320 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29269b6-03ba-4bc3-8fee-a5c3e228124d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:33.405742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29269b6-03ba-4bc3-8fee-a5c3e228124d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:33.406425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29269b6-03ba-4bc3-8fee-a5c3e228124d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:33.406897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29269b6-03ba-4bc3-8fee-a5c3e228124d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:33.407351 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29269b6-03ba-4bc3-8fee-a5c3e228124d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:33.539877 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d29269b6-03ba-4bc3-8fee-a5c3e228124d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:33.547798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d29269b6-03ba-4bc3-8fee-a5c3e228124d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.153825 Aug 10 16:57:33.548400 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 209/414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:33 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:33.598729 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c71d8aaa-490d-4410-9abd-dee1fcc0eea5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:33.599372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c71d8aaa-490d-4410-9abd-dee1fcc0eea5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:33.605960 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c71d8aaa-490d-4410-9abd-dee1fcc0eea5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:33.607062 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c71d8aaa-490d-4410-9abd-dee1fcc0eea5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:33.607510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c71d8aaa-490d-4410-9abd-dee1fcc0eea5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:33.608238 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c71d8aaa-490d-4410-9abd-dee1fcc0eea5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:33.608691 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c71d8aaa-490d-4410-9abd-dee1fcc0eea5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:33.609112 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c71d8aaa-490d-4410-9abd-dee1fcc0eea5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:33.674439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c71d8aaa-490d-4410-9abd-dee1fcc0eea5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:33.682057 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c71d8aaa-490d-4410-9abd-dee1fcc0eea5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1209 microversion: 2.1 time: 0.087022 Aug 10 16:57:33.682619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 206/415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:33 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:34.569925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6676d7ae-b1e4-44a7-8544-ef6ab16eb0a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:34.570477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6676d7ae-b1e4-44a7-8544-ef6ab16eb0a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:34.576513 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6676d7ae-b1e4-44a7-8544-ef6ab16eb0a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:34.576993 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6676d7ae-b1e4-44a7-8544-ef6ab16eb0a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:34.577427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6676d7ae-b1e4-44a7-8544-ef6ab16eb0a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:34.578112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6676d7ae-b1e4-44a7-8544-ef6ab16eb0a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:34.578560 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6676d7ae-b1e4-44a7-8544-ef6ab16eb0a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:34.579014 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6676d7ae-b1e4-44a7-8544-ef6ab16eb0a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:34.702655 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de53d6da-0ace-4204-a060-0b2b9e248bde tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:34.703348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-de53d6da-0ace-4204-a060-0b2b9e248bde tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:34.705464 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6676d7ae-b1e4-44a7-8544-ef6ab16eb0a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:34.709932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de53d6da-0ace-4204-a060-0b2b9e248bde tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:34.710420 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de53d6da-0ace-4204-a060-0b2b9e248bde tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:34.710856 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de53d6da-0ace-4204-a060-0b2b9e248bde tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:34.711555 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de53d6da-0ace-4204-a060-0b2b9e248bde tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:34.712009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de53d6da-0ace-4204-a060-0b2b9e248bde tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:34.712464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de53d6da-0ace-4204-a060-0b2b9e248bde tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:34.713191 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6676d7ae-b1e4-44a7-8544-ef6ab16eb0a3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.147213 Aug 10 16:57:34.713761 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 210/416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:34 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:34.773711 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-de53d6da-0ace-4204-a060-0b2b9e248bde tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:34.781161 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-de53d6da-0ace-4204-a060-0b2b9e248bde tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1209 microversion: 2.1 time: 0.082314 Aug 10 16:57:34.781723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 207/417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:34 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:35.733838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e602c517-8bbb-4f54-9660-cdd47986e074 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:35.734448 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e602c517-8bbb-4f54-9660-cdd47986e074 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:35.740277 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e602c517-8bbb-4f54-9660-cdd47986e074 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:35.740760 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e602c517-8bbb-4f54-9660-cdd47986e074 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:35.741190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e602c517-8bbb-4f54-9660-cdd47986e074 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:35.741869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e602c517-8bbb-4f54-9660-cdd47986e074 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:35.742319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e602c517-8bbb-4f54-9660-cdd47986e074 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:35.742738 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e602c517-8bbb-4f54-9660-cdd47986e074 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:35.801902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-728387e5-06d5-435c-9361-a4c4e06e2069 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:35.802539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-728387e5-06d5-435c-9361-a4c4e06e2069 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:35.808882 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-728387e5-06d5-435c-9361-a4c4e06e2069 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:35.809847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-728387e5-06d5-435c-9361-a4c4e06e2069 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:35.810288 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-728387e5-06d5-435c-9361-a4c4e06e2069 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:35.810980 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-728387e5-06d5-435c-9361-a4c4e06e2069 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:35.811432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-728387e5-06d5-435c-9361-a4c4e06e2069 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:35.811865 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-728387e5-06d5-435c-9361-a4c4e06e2069 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:35.874754 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-728387e5-06d5-435c-9361-a4c4e06e2069 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:35.879796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e602c517-8bbb-4f54-9660-cdd47986e074 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:35.883500 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-728387e5-06d5-435c-9361-a4c4e06e2069 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1265 microversion: 2.1 time: 0.085393 Aug 10 16:57:35.884071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 208/418] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:35 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:35.897301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e602c517-8bbb-4f54-9660-cdd47986e074 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.167274 Aug 10 16:57:35.897859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 211/419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:35 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:36.904843 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f42a4408-1c0a-4caa-8743-02a4950679e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:36.905469 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f42a4408-1c0a-4caa-8743-02a4950679e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:36.913352 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f42a4408-1c0a-4caa-8743-02a4950679e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:36.913826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f42a4408-1c0a-4caa-8743-02a4950679e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:36.914252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f42a4408-1c0a-4caa-8743-02a4950679e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:36.915275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f42a4408-1c0a-4caa-8743-02a4950679e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:36.915895 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f42a4408-1c0a-4caa-8743-02a4950679e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:36.916544 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f42a4408-1c0a-4caa-8743-02a4950679e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:36.918883 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-150cbda3-9d14-41e0-a9dd-78b1f6b39844 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:36.919996 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-150cbda3-9d14-41e0-a9dd-78b1f6b39844 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:36.929333 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-150cbda3-9d14-41e0-a9dd-78b1f6b39844 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:36.930938 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-150cbda3-9d14-41e0-a9dd-78b1f6b39844 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:36.932123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-150cbda3-9d14-41e0-a9dd-78b1f6b39844 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:36.933549 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-150cbda3-9d14-41e0-a9dd-78b1f6b39844 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:36.935009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-150cbda3-9d14-41e0-a9dd-78b1f6b39844 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:36.937190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-150cbda3-9d14-41e0-a9dd-78b1f6b39844 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:37.087801 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f42a4408-1c0a-4caa-8743-02a4950679e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:37.095837 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f42a4408-1c0a-4caa-8743-02a4950679e0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.195307 Aug 10 16:57:37.096473 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 209/420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:36 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:37.097767 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-150cbda3-9d14-41e0-a9dd-78b1f6b39844 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:37.105692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-150cbda3-9d14-41e0-a9dd-78b1f6b39844 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.191286 Aug 10 16:57:37.106304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 212/421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:36 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:38.118204 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d888732f-04b7-498e-ac1e-c8326c83bbba tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:38.118833 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d888732f-04b7-498e-ac1e-c8326c83bbba tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:38.125952 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d888732f-04b7-498e-ac1e-c8326c83bbba tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:38.126556 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d888732f-04b7-498e-ac1e-c8326c83bbba tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:38.127089 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d888732f-04b7-498e-ac1e-c8326c83bbba tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:38.127599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eaec1af2-1d38-4d4f-bf91-5c80ad728f00 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:38.128061 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d888732f-04b7-498e-ac1e-c8326c83bbba tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:38.128223 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-eaec1af2-1d38-4d4f-bf91-5c80ad728f00 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:38.128647 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d888732f-04b7-498e-ac1e-c8326c83bbba tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:38.129127 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d888732f-04b7-498e-ac1e-c8326c83bbba tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:38.130598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:38.131555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:38.137466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eaec1af2-1d38-4d4f-bf91-5c80ad728f00 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:38.138158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eaec1af2-1d38-4d4f-bf91-5c80ad728f00 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:38.138589 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eaec1af2-1d38-4d4f-bf91-5c80ad728f00 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:38.139279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eaec1af2-1d38-4d4f-bf91-5c80ad728f00 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:38.139724 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eaec1af2-1d38-4d4f-bf91-5c80ad728f00 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:38.140229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eaec1af2-1d38-4d4f-bf91-5c80ad728f00 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:38.186020 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:38.274841 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d888732f-04b7-498e-ac1e-c8326c83bbba tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:38.280796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-eaec1af2-1d38-4d4f-bf91-5c80ad728f00 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:38.283039 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d888732f-04b7-498e-ac1e-c8326c83bbba tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.168511 Aug 10 16:57:38.283613 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 210/422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:38 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:38.288495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-eaec1af2-1d38-4d4f-bf91-5c80ad728f00 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.164498 Aug 10 16:57:38.289119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 213/423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:38 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:39.303809 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-13225a0b-01a6-48e1-994f-febe39e74e38 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:39.304442 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-13225a0b-01a6-48e1-994f-febe39e74e38 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:39.308273 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6a36c9f5-9f79-41ef-a6b0-2f27d8a0fac5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:39.308914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6a36c9f5-9f79-41ef-a6b0-2f27d8a0fac5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:39.311400 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13225a0b-01a6-48e1-994f-febe39e74e38 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:39.311885 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13225a0b-01a6-48e1-994f-febe39e74e38 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:39.312417 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13225a0b-01a6-48e1-994f-febe39e74e38 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:39.313110 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13225a0b-01a6-48e1-994f-febe39e74e38 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:39.313563 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13225a0b-01a6-48e1-994f-febe39e74e38 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:39.313989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13225a0b-01a6-48e1-994f-febe39e74e38 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:39.315628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a36c9f5-9f79-41ef-a6b0-2f27d8a0fac5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:39.316112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a36c9f5-9f79-41ef-a6b0-2f27d8a0fac5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:39.316574 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a36c9f5-9f79-41ef-a6b0-2f27d8a0fac5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:39.317262 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a36c9f5-9f79-41ef-a6b0-2f27d8a0fac5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:39.317744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a36c9f5-9f79-41ef-a6b0-2f27d8a0fac5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:39.318167 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a36c9f5-9f79-41ef-a6b0-2f27d8a0fac5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:39.441946 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-13225a0b-01a6-48e1-994f-febe39e74e38 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:39.449330 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-13225a0b-01a6-48e1-994f-febe39e74e38 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.149311 Aug 10 16:57:39.449937 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 211/424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:39 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:39.459397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6a36c9f5-9f79-41ef-a6b0-2f27d8a0fac5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:39.467544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6a36c9f5-9f79-41ef-a6b0-2f27d8a0fac5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.163121 Aug 10 16:57:39.468035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 214/425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:39 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:40.356356 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-fb86a917-f489-4119-ac34-a724d5f631a6 req-44871dda-2f1e-46b9-83b4-a8c999f3c3cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eff2519-521a-448f-9e2d-c449080ca49c", "tag": "ab9f62b5-4500-4eb8-9e41-5befea412bc3"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:57:40.361876 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=46 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:40.368208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fb86a917-f489-4119-ac34-a724d5f631a6 req-44871dda-2f1e-46b9-83b4-a8c999f3c3cb service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:40.368896 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fb86a917-f489-4119-ac34-a724d5f631a6 req-44871dda-2f1e-46b9-83b4-a8c999f3c3cb service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:40.369370 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fb86a917-f489-4119-ac34-a724d5f631a6 req-44871dda-2f1e-46b9-83b4-a8c999f3c3cb service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:40.381036 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-fb86a917-f489-4119-ac34-a724d5f631a6 req-44871dda-2f1e-46b9-83b4-a8c999f3c3cb service nova] Creating event network-changed:ab9f62b5-4500-4eb8-9e41-5befea412bc3 for instance 3eff2519-521a-448f-9e2d-c449080ca49c on hv-cinder-83602 Aug 10 16:57:40.385993 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-fb86a917-f489-4119-ac34-a724d5f631a6 req-44871dda-2f1e-46b9-83b4-a8c999f3c3cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033529 Aug 10 16:57:40.386631 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 212/426] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:57:40.470444 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ea695070-8b11-421d-8c5d-caf80b6782c4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:40.471056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ea695070-8b11-421d-8c5d-caf80b6782c4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:40.476899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea695070-8b11-421d-8c5d-caf80b6782c4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:40.477388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea695070-8b11-421d-8c5d-caf80b6782c4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:40.477819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea695070-8b11-421d-8c5d-caf80b6782c4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:40.478504 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea695070-8b11-421d-8c5d-caf80b6782c4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:40.478952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea695070-8b11-421d-8c5d-caf80b6782c4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:40.479371 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea695070-8b11-421d-8c5d-caf80b6782c4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:40.489982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-49d7592f-0118-42bd-b5ed-0556f4341b7d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:40.491118 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-49d7592f-0118-42bd-b5ed-0556f4341b7d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:40.499451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49d7592f-0118-42bd-b5ed-0556f4341b7d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:40.499934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49d7592f-0118-42bd-b5ed-0556f4341b7d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:40.500601 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49d7592f-0118-42bd-b5ed-0556f4341b7d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:40.501301 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49d7592f-0118-42bd-b5ed-0556f4341b7d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:40.501750 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49d7592f-0118-42bd-b5ed-0556f4341b7d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:40.502167 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49d7592f-0118-42bd-b5ed-0556f4341b7d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:40.634245 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ea695070-8b11-421d-8c5d-caf80b6782c4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:40.649550 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ea695070-8b11-421d-8c5d-caf80b6782c4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.182850 Aug 10 16:57:40.650388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 215/427] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:40 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:40.674875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-49d7592f-0118-42bd-b5ed-0556f4341b7d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:40.682435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-49d7592f-0118-42bd-b5ed-0556f4341b7d tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.197752 Aug 10 16:57:40.683094 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 213/428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:40 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:41.670743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4be76234-2706-4dac-9620-fdee5ff2d2a1 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:41.671514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4be76234-2706-4dac-9620-fdee5ff2d2a1 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:41.675539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:41.679148 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4be76234-2706-4dac-9620-fdee5ff2d2a1 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:41.679596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4be76234-2706-4dac-9620-fdee5ff2d2a1 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:41.680040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4be76234-2706-4dac-9620-fdee5ff2d2a1 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:41.680743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4be76234-2706-4dac-9620-fdee5ff2d2a1 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:41.681326 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4be76234-2706-4dac-9620-fdee5ff2d2a1 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:41.681804 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4be76234-2706-4dac-9620-fdee5ff2d2a1 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:41.705383 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-734a4451-ece5-4cd7-976e-fa00604a5b3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:41.706069 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-734a4451-ece5-4cd7-976e-fa00604a5b3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:41.710573 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:41.716470 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-734a4451-ece5-4cd7-976e-fa00604a5b3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:41.716977 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-734a4451-ece5-4cd7-976e-fa00604a5b3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:41.717421 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-734a4451-ece5-4cd7-976e-fa00604a5b3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:41.718334 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-734a4451-ece5-4cd7-976e-fa00604a5b3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:41.719071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-734a4451-ece5-4cd7-976e-fa00604a5b3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:41.719505 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-734a4451-ece5-4cd7-976e-fa00604a5b3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:41.863494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-734a4451-ece5-4cd7-976e-fa00604a5b3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:41.871368 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-734a4451-ece5-4cd7-976e-fa00604a5b3a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.169749 Aug 10 16:57:41.872506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 214/429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:41 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:42.022649 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4be76234-2706-4dac-9620-fdee5ff2d2a1 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:42.030980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4be76234-2706-4dac-9620-fdee5ff2d2a1 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.364059 Aug 10 16:57:42.032046 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 216/430] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:41 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:42.894271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e736ae39-7c43-4869-9acb-dad47d4bfd2e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:42.894908 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e736ae39-7c43-4869-9acb-dad47d4bfd2e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:42.901413 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e736ae39-7c43-4869-9acb-dad47d4bfd2e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:42.901902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e736ae39-7c43-4869-9acb-dad47d4bfd2e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:42.902343 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e736ae39-7c43-4869-9acb-dad47d4bfd2e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:42.903599 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e736ae39-7c43-4869-9acb-dad47d4bfd2e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:42.904058 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e736ae39-7c43-4869-9acb-dad47d4bfd2e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:42.904513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e736ae39-7c43-4869-9acb-dad47d4bfd2e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:43.039566 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e736ae39-7c43-4869-9acb-dad47d4bfd2e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:43.047227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e736ae39-7c43-4869-9acb-dad47d4bfd2e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.156681 Aug 10 16:57:43.047800 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 215/431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:42 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:43.054358 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d7d98e8d-a6f5-4942-905a-1ea35ebc6306 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:43.054982 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d7d98e8d-a6f5-4942-905a-1ea35ebc6306 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:43.061539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7d98e8d-a6f5-4942-905a-1ea35ebc6306 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:43.062027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7d98e8d-a6f5-4942-905a-1ea35ebc6306 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:43.062467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7d98e8d-a6f5-4942-905a-1ea35ebc6306 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:43.063162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7d98e8d-a6f5-4942-905a-1ea35ebc6306 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:43.063616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7d98e8d-a6f5-4942-905a-1ea35ebc6306 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:43.064037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7d98e8d-a6f5-4942-905a-1ea35ebc6306 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:43.294746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d7d98e8d-a6f5-4942-905a-1ea35ebc6306 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:43.302264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d7d98e8d-a6f5-4942-905a-1ea35ebc6306 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.253439 Aug 10 16:57:43.302925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 217/432] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:43 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:44.068324 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db202078-55d1-4134-aa9e-df54a0867ce6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:44.068943 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-db202078-55d1-4134-aa9e-df54a0867ce6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:44.075245 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db202078-55d1-4134-aa9e-df54a0867ce6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:44.075737 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db202078-55d1-4134-aa9e-df54a0867ce6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:44.076189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db202078-55d1-4134-aa9e-df54a0867ce6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:44.076883 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db202078-55d1-4134-aa9e-df54a0867ce6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:44.077347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db202078-55d1-4134-aa9e-df54a0867ce6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:44.077775 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db202078-55d1-4134-aa9e-df54a0867ce6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:44.203806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-db202078-55d1-4134-aa9e-df54a0867ce6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:44.211478 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-db202078-55d1-4134-aa9e-df54a0867ce6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1502 microversion: 2.1 time: 0.147095 Aug 10 16:57:44.212125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 216/433] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:44 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:44.233412 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "385527b4-bd02-48fc-b35e-fb7ea6a4f76d"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:57:44.236091 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:44.242249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:44.242732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:44.243163 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:44.243910 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:44.244397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:44.244818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:44.268507 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] HTTP exception thrown: Cannot 'attach_volume' instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 while it is in vm_state rescued Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Request method failure captured: Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: POST /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9/os-volume_attachments HTTP/1.1 Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 74 Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lh1I9b-kzb_slWPvAVutdni9VM3659dFbvGG7qTcP042PDQs7hDKYwoJmH321qx5VWPk96Wr1z1hO4peTcy8akv6z-FleuR3FxKhnCOsmN7o9e6S20CSWhLrQ8J54JBEp1JiIbuk9o27XYyUSIPF3W2AYMFe1yND8oP5BURIf_OIQ Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 36cf7bbfa5d3420996a2af036cf8e0da Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:57:44.270181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36cf7bbfa5d3420996a2af036cf8e0da", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 36cf7bbfa5d3420996a2af036cf8e0da Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-ServerRescueNegativeTestJSON-1943156217-project Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: c7fac765624c4e0b85b01f356a14a1cb Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1943156217-project Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {"volumeAttachment": {"volumeId": "385527b4-bd02-48fc-b35e-fb7ea6a4f76d"}} Aug 10 16:57:44.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Cannot 'attach_volume' instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 while it is in vm_state rescued Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'server_id': 'cf8017eb-1d19-483c-b2ee-e5d8b07b16e9', 'body': {'volumeAttachment': {'volumeId': '385527b4-bd02-48fc-b35e-fb7ea6a4f76d'}}} Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:57:44.272929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 while it is in vm_state rescued Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:57:44.274388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:57:44.275654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:57:44.275654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:57:44.275654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 while it is in vm_state rescued Aug 10 16:57:44.275654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:57:44.275654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Returning 409 to user: Cannot 'attach_volume' instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 while it is in vm_state rescued {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:57:44.275654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e00e668a-912f-4a46-9286-95dd6e167ec2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "POST /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042763 Aug 10 16:57:44.275654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 218/434] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 16:57:44 2022] POST /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 16:57:44.281816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-190ed99b-39d8-492f-ab98-802c20229e12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:57:44.282713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-190ed99b-39d8-492f-ab98-802c20229e12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:44.288399 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190ed99b-39d8-492f-ab98-802c20229e12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:44.288965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190ed99b-39d8-492f-ab98-802c20229e12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:44.289410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190ed99b-39d8-492f-ab98-802c20229e12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:44.290105 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190ed99b-39d8-492f-ab98-802c20229e12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:44.290558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190ed99b-39d8-492f-ab98-802c20229e12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:44.290981 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190ed99b-39d8-492f-ab98-802c20229e12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:44.327986 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-838981a8-9cd0-48d5-8eb6-61c010b5d1fe tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:44.328626 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-838981a8-9cd0-48d5-8eb6-61c010b5d1fe tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:44.337630 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838981a8-9cd0-48d5-8eb6-61c010b5d1fe tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:44.338343 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838981a8-9cd0-48d5-8eb6-61c010b5d1fe tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:44.338925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838981a8-9cd0-48d5-8eb6-61c010b5d1fe tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:44.340308 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838981a8-9cd0-48d5-8eb6-61c010b5d1fe tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:44.341546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838981a8-9cd0-48d5-8eb6-61c010b5d1fe tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:44.342426 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838981a8-9cd0-48d5-8eb6-61c010b5d1fe tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:44.368569 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-190ed99b-39d8-492f-ab98-802c20229e12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "POST /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9/action" status: 202 len: 0 microversion: 2.1 time: 0.090957 Aug 10 16:57:44.369752 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 217/435] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 16:57:44 2022] POST /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 16:57:44.377997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d8910c9f-ce58-47b8-9d91-8fe1dcdd4305 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:44.378814 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d8910c9f-ce58-47b8-9d91-8fe1dcdd4305 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:44.385166 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8910c9f-ce58-47b8-9d91-8fe1dcdd4305 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:44.385733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8910c9f-ce58-47b8-9d91-8fe1dcdd4305 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:44.386300 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8910c9f-ce58-47b8-9d91-8fe1dcdd4305 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:44.387080 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8910c9f-ce58-47b8-9d91-8fe1dcdd4305 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:44.388066 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8910c9f-ce58-47b8-9d91-8fe1dcdd4305 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:44.388534 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8910c9f-ce58-47b8-9d91-8fe1dcdd4305 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:44.514249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-838981a8-9cd0-48d5-8eb6-61c010b5d1fe tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:44.522082 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-838981a8-9cd0-48d5-8eb6-61c010b5d1fe tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.201050 Aug 10 16:57:44.522653 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 219/436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:44 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:44.524268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d8910c9f-ce58-47b8-9d91-8fe1dcdd4305 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:44.532279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d8910c9f-ce58-47b8-9d91-8fe1dcdd4305 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.158294 Aug 10 16:57:44.536175 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 218/437] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:44 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:45.544105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a6af9817-748a-4af7-b727-57d8f4aa5cb8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:45.544757 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a6af9817-748a-4af7-b727-57d8f4aa5cb8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:45.550746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6af9817-748a-4af7-b727-57d8f4aa5cb8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:45.551206 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6af9817-748a-4af7-b727-57d8f4aa5cb8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:45.551642 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6af9817-748a-4af7-b727-57d8f4aa5cb8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:45.552359 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6af9817-748a-4af7-b727-57d8f4aa5cb8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:45.552810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6af9817-748a-4af7-b727-57d8f4aa5cb8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:45.553232 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6af9817-748a-4af7-b727-57d8f4aa5cb8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:45.553327 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-381f92be-c79b-46ba-b323-20acd72ac3cf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:45.553969 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-381f92be-c79b-46ba-b323-20acd72ac3cf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:45.560297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-381f92be-c79b-46ba-b323-20acd72ac3cf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:45.560778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-381f92be-c79b-46ba-b323-20acd72ac3cf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:45.561208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-381f92be-c79b-46ba-b323-20acd72ac3cf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:45.561888 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-381f92be-c79b-46ba-b323-20acd72ac3cf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:45.562339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-381f92be-c79b-46ba-b323-20acd72ac3cf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:45.562756 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-381f92be-c79b-46ba-b323-20acd72ac3cf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:45.680107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a6af9817-748a-4af7-b727-57d8f4aa5cb8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:45.687644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a6af9817-748a-4af7-b727-57d8f4aa5cb8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.147947 Aug 10 16:57:45.688242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 220/438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:45 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:45.691584 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-381f92be-c79b-46ba-b323-20acd72ac3cf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:45.699576 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-381f92be-c79b-46ba-b323-20acd72ac3cf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.150040 Aug 10 16:57:45.700191 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 219/439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:45 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:46.711249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8b9d5e57-dc09-4903-9413-5b41805726f8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:46.711864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8b9d5e57-dc09-4903-9413-5b41805726f8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:46.717875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b9d5e57-dc09-4903-9413-5b41805726f8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:46.718362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b9d5e57-dc09-4903-9413-5b41805726f8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:46.718796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b9d5e57-dc09-4903-9413-5b41805726f8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:46.719487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b9d5e57-dc09-4903-9413-5b41805726f8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:46.719937 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b9d5e57-dc09-4903-9413-5b41805726f8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:46.720449 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b6239be-fd0f-4bbc-9624-a9869ec801e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:46.720846 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b9d5e57-dc09-4903-9413-5b41805726f8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:46.721179 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9b6239be-fd0f-4bbc-9624-a9869ec801e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:46.727526 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b6239be-fd0f-4bbc-9624-a9869ec801e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:46.728008 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b6239be-fd0f-4bbc-9624-a9869ec801e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:46.728478 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b6239be-fd0f-4bbc-9624-a9869ec801e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:46.729164 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b6239be-fd0f-4bbc-9624-a9869ec801e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:46.729613 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b6239be-fd0f-4bbc-9624-a9869ec801e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:46.730034 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b6239be-fd0f-4bbc-9624-a9869ec801e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:46.851804 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8b9d5e57-dc09-4903-9413-5b41805726f8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:46.855511 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b6239be-fd0f-4bbc-9624-a9869ec801e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:46.859872 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8b9d5e57-dc09-4903-9413-5b41805726f8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.152900 Aug 10 16:57:46.860473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 221/440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:46 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:46.863240 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b6239be-fd0f-4bbc-9624-a9869ec801e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.146456 Aug 10 16:57:46.863922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 220/441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:46 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:47.882270 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0275e442-f780-4403-a4d5-55fceaf32816 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:47.882911 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0275e442-f780-4403-a4d5-55fceaf32816 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:47.884308 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-979fdf9b-62ae-43fc-aa80-03a38181a6e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:47.884920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-979fdf9b-62ae-43fc-aa80-03a38181a6e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:47.888931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0275e442-f780-4403-a4d5-55fceaf32816 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:47.889407 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0275e442-f780-4403-a4d5-55fceaf32816 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:47.889833 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0275e442-f780-4403-a4d5-55fceaf32816 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:47.890517 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0275e442-f780-4403-a4d5-55fceaf32816 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:47.890961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0275e442-f780-4403-a4d5-55fceaf32816 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:47.891365 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-979fdf9b-62ae-43fc-aa80-03a38181a6e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:47.891461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0275e442-f780-4403-a4d5-55fceaf32816 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:47.891848 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-979fdf9b-62ae-43fc-aa80-03a38181a6e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:47.892310 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-979fdf9b-62ae-43fc-aa80-03a38181a6e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:47.892999 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-979fdf9b-62ae-43fc-aa80-03a38181a6e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:47.893459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-979fdf9b-62ae-43fc-aa80-03a38181a6e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:47.893885 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-979fdf9b-62ae-43fc-aa80-03a38181a6e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:48.023056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0275e442-f780-4403-a4d5-55fceaf32816 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:48.031461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0275e442-f780-4403-a4d5-55fceaf32816 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.153733 Aug 10 16:57:48.032048 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 222/442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:47 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:48.244336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-979fdf9b-62ae-43fc-aa80-03a38181a6e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:48.251746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-979fdf9b-62ae-43fc-aa80-03a38181a6e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.371232 Aug 10 16:57:48.252320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 221/443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:47 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:49.052588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b56ee9c9-ad36-4c9d-a48c-ee3f9748b0dc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:49.053223 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b56ee9c9-ad36-4c9d-a48c-ee3f9748b0dc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:49.059177 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b56ee9c9-ad36-4c9d-a48c-ee3f9748b0dc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:49.060310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b56ee9c9-ad36-4c9d-a48c-ee3f9748b0dc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:49.060743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b56ee9c9-ad36-4c9d-a48c-ee3f9748b0dc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:49.061424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b56ee9c9-ad36-4c9d-a48c-ee3f9748b0dc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:49.061873 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b56ee9c9-ad36-4c9d-a48c-ee3f9748b0dc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:49.062293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b56ee9c9-ad36-4c9d-a48c-ee3f9748b0dc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:49.191568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b56ee9c9-ad36-4c9d-a48c-ee3f9748b0dc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:49.198887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b56ee9c9-ad36-4c9d-a48c-ee3f9748b0dc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.150575 Aug 10 16:57:49.199449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 223/444] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:49 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:49.274676 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6c037ace-e161-4768-8e48-590bb4c4d366 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:49.275268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6c037ace-e161-4768-8e48-590bb4c4d366 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:49.282112 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c037ace-e161-4768-8e48-590bb4c4d366 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:49.282601 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c037ace-e161-4768-8e48-590bb4c4d366 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:49.283038 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c037ace-e161-4768-8e48-590bb4c4d366 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:49.283731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c037ace-e161-4768-8e48-590bb4c4d366 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:49.284205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c037ace-e161-4768-8e48-590bb4c4d366 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:49.284646 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c037ace-e161-4768-8e48-590bb4c4d366 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:49.288817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:49.414565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6c037ace-e161-4768-8e48-590bb4c4d366 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:49.422713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6c037ace-e161-4768-8e48-590bb4c4d366 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.152050 Aug 10 16:57:49.423276 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 222/445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:49 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:50.219712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a13cbfab-d2df-4a90-ab85-ead1209bd1b2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:50.220346 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a13cbfab-d2df-4a90-ab85-ead1209bd1b2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:50.226067 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a13cbfab-d2df-4a90-ab85-ead1209bd1b2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:50.226539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a13cbfab-d2df-4a90-ab85-ead1209bd1b2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:50.226964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a13cbfab-d2df-4a90-ab85-ead1209bd1b2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:50.227636 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a13cbfab-d2df-4a90-ab85-ead1209bd1b2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:50.228074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a13cbfab-d2df-4a90-ab85-ead1209bd1b2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:50.228515 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a13cbfab-d2df-4a90-ab85-ead1209bd1b2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:50.361018 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a13cbfab-d2df-4a90-ab85-ead1209bd1b2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:50.368707 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a13cbfab-d2df-4a90-ab85-ead1209bd1b2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.152884 Aug 10 16:57:50.369280 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 224/446] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:50 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:50.443133 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b4a6546-6328-4990-8e60-8ce7b9aa7540 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:50.443674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b4a6546-6328-4990-8e60-8ce7b9aa7540 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:50.449929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b4a6546-6328-4990-8e60-8ce7b9aa7540 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:50.450409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b4a6546-6328-4990-8e60-8ce7b9aa7540 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:50.450838 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b4a6546-6328-4990-8e60-8ce7b9aa7540 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:50.451519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b4a6546-6328-4990-8e60-8ce7b9aa7540 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:50.451971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b4a6546-6328-4990-8e60-8ce7b9aa7540 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:50.452422 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b4a6546-6328-4990-8e60-8ce7b9aa7540 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:50.583420 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4b4a6546-6328-4990-8e60-8ce7b9aa7540 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:50.590964 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b4a6546-6328-4990-8e60-8ce7b9aa7540 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.151779 Aug 10 16:57:50.591849 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 223/447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:50 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:51.392462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e0f431f9-ccdf-454a-8b74-518c3637dc8c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:51.393063 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e0f431f9-ccdf-454a-8b74-518c3637dc8c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:51.398773 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0f431f9-ccdf-454a-8b74-518c3637dc8c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:51.399246 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0f431f9-ccdf-454a-8b74-518c3637dc8c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:51.399718 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0f431f9-ccdf-454a-8b74-518c3637dc8c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:51.400419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0f431f9-ccdf-454a-8b74-518c3637dc8c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:51.400865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0f431f9-ccdf-454a-8b74-518c3637dc8c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:51.401281 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0f431f9-ccdf-454a-8b74-518c3637dc8c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:51.531884 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e0f431f9-ccdf-454a-8b74-518c3637dc8c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:51.539122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e0f431f9-ccdf-454a-8b74-518c3637dc8c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.150439 Aug 10 16:57:51.539688 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 225/448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:51 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:51.612001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bab6c509-2c59-43cd-8142-0ef3fbfd5a7e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:51.612818 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bab6c509-2c59-43cd-8142-0ef3fbfd5a7e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:51.618625 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bab6c509-2c59-43cd-8142-0ef3fbfd5a7e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:51.619108 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bab6c509-2c59-43cd-8142-0ef3fbfd5a7e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:51.619547 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bab6c509-2c59-43cd-8142-0ef3fbfd5a7e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:51.620264 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bab6c509-2c59-43cd-8142-0ef3fbfd5a7e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:51.620723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bab6c509-2c59-43cd-8142-0ef3fbfd5a7e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:51.621151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bab6c509-2c59-43cd-8142-0ef3fbfd5a7e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:51.753338 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bab6c509-2c59-43cd-8142-0ef3fbfd5a7e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:51.760874 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bab6c509-2c59-43cd-8142-0ef3fbfd5a7e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.152948 Aug 10 16:57:51.761923 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 224/449] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:51 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:52.558758 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-205446a6-f611-4992-8a37-ecbe414ced73 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:52.559409 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-205446a6-f611-4992-8a37-ecbe414ced73 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:52.567098 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-205446a6-f611-4992-8a37-ecbe414ced73 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:52.567676 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-205446a6-f611-4992-8a37-ecbe414ced73 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:52.568633 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-205446a6-f611-4992-8a37-ecbe414ced73 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:52.569331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-205446a6-f611-4992-8a37-ecbe414ced73 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:52.569872 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-205446a6-f611-4992-8a37-ecbe414ced73 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:52.570363 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-205446a6-f611-4992-8a37-ecbe414ced73 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:52.783261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5a1af283-2095-458e-97de-f5d2a423a248 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:52.784564 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5a1af283-2095-458e-97de-f5d2a423a248 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:52.792387 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a1af283-2095-458e-97de-f5d2a423a248 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:52.793044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a1af283-2095-458e-97de-f5d2a423a248 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:52.793782 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a1af283-2095-458e-97de-f5d2a423a248 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:52.795134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a1af283-2095-458e-97de-f5d2a423a248 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:52.796069 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a1af283-2095-458e-97de-f5d2a423a248 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:52.796568 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a1af283-2095-458e-97de-f5d2a423a248 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:52.876809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-205446a6-f611-4992-8a37-ecbe414ced73 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:52.885271 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-205446a6-f611-4992-8a37-ecbe414ced73 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.330254 Aug 10 16:57:52.885988 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 226/450] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:52 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:52.940962 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5a1af283-2095-458e-97de-f5d2a423a248 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:52.949510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5a1af283-2095-458e-97de-f5d2a423a248 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.171472 Aug 10 16:57:52.950930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 225/451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:52 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:53.907650 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7a395927-eaa2-4e59-9ff6-421b901af989 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:53.908600 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7a395927-eaa2-4e59-9ff6-421b901af989 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:53.916056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a395927-eaa2-4e59-9ff6-421b901af989 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:53.916845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a395927-eaa2-4e59-9ff6-421b901af989 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:53.917560 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a395927-eaa2-4e59-9ff6-421b901af989 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:53.918598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a395927-eaa2-4e59-9ff6-421b901af989 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:53.919201 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a395927-eaa2-4e59-9ff6-421b901af989 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:53.919869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a395927-eaa2-4e59-9ff6-421b901af989 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:53.971435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc813909-c843-48c5-a9bb-307be9ab6797 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:53.972848 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bc813909-c843-48c5-a9bb-307be9ab6797 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:53.982823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc813909-c843-48c5-a9bb-307be9ab6797 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:53.983320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc813909-c843-48c5-a9bb-307be9ab6797 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:53.983758 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc813909-c843-48c5-a9bb-307be9ab6797 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:53.984515 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc813909-c843-48c5-a9bb-307be9ab6797 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:53.984971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc813909-c843-48c5-a9bb-307be9ab6797 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:53.985398 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc813909-c843-48c5-a9bb-307be9ab6797 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:54.105389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7a395927-eaa2-4e59-9ff6-421b901af989 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:54.113925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7a395927-eaa2-4e59-9ff6-421b901af989 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.210649 Aug 10 16:57:54.114530 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 227/452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:53 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:54.183011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc813909-c843-48c5-a9bb-307be9ab6797 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:54.191222 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bc813909-c843-48c5-a9bb-307be9ab6797 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.224005 Aug 10 16:57:54.191789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 226/453] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:53 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:55.134193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1ee51f73-53a6-49e2-9a25-83dc6fa61235 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:55.134791 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1ee51f73-53a6-49e2-9a25-83dc6fa61235 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:55.141144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ee51f73-53a6-49e2-9a25-83dc6fa61235 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:55.141618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ee51f73-53a6-49e2-9a25-83dc6fa61235 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:55.142043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ee51f73-53a6-49e2-9a25-83dc6fa61235 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:55.142725 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ee51f73-53a6-49e2-9a25-83dc6fa61235 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:55.143166 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ee51f73-53a6-49e2-9a25-83dc6fa61235 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:55.143577 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ee51f73-53a6-49e2-9a25-83dc6fa61235 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:55.214393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-077106ec-468a-4ab9-a559-164ad2671bd5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:55.215033 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-077106ec-468a-4ab9-a559-164ad2671bd5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:55.221371 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077106ec-468a-4ab9-a559-164ad2671bd5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:55.221893 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077106ec-468a-4ab9-a559-164ad2671bd5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:55.222330 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077106ec-468a-4ab9-a559-164ad2671bd5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:55.223372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077106ec-468a-4ab9-a559-164ad2671bd5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:55.223457 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077106ec-468a-4ab9-a559-164ad2671bd5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:55.223868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077106ec-468a-4ab9-a559-164ad2671bd5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:55.278963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1ee51f73-53a6-49e2-9a25-83dc6fa61235 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:55.289414 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1ee51f73-53a6-49e2-9a25-83dc6fa61235 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.158579 Aug 10 16:57:55.289999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 228/454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:55 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:55.358640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-077106ec-468a-4ab9-a559-164ad2671bd5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:55.366848 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-077106ec-468a-4ab9-a559-164ad2671bd5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.156351 Aug 10 16:57:55.367519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 227/455] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:55 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:56.053379 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-62af4945-0a39-4d80-b780-fd9bffdee675 req-417e18ab-c9f7-4cdf-86e7-8f5293f58448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eff2519-521a-448f-9e2d-c449080ca49c", "name": "network-vif-plugged", "status": "completed", "tag": "ab9f62b5-4500-4eb8-9e41-5befea412bc3"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:57:56.062430 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-62af4945-0a39-4d80-b780-fd9bffdee675 req-417e18ab-c9f7-4cdf-86e7-8f5293f58448 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:56.062879 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-62af4945-0a39-4d80-b780-fd9bffdee675 req-417e18ab-c9f7-4cdf-86e7-8f5293f58448 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:56.063326 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-62af4945-0a39-4d80-b780-fd9bffdee675 req-417e18ab-c9f7-4cdf-86e7-8f5293f58448 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:56.074579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-62af4945-0a39-4d80-b780-fd9bffdee675 req-417e18ab-c9f7-4cdf-86e7-8f5293f58448 service nova] Creating event network-vif-plugged:ab9f62b5-4500-4eb8-9e41-5befea412bc3 for instance 3eff2519-521a-448f-9e2d-c449080ca49c on hv-cinder-83602 Aug 10 16:57:56.079584 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-62af4945-0a39-4d80-b780-fd9bffdee675 req-417e18ab-c9f7-4cdf-86e7-8f5293f58448 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030193 Aug 10 16:57:56.080363 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 229/456] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:57:56.310337 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-694f1079-5299-44ad-afb6-1c13e04633da tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:56.310952 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-694f1079-5299-44ad-afb6-1c13e04633da tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:56.317385 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694f1079-5299-44ad-afb6-1c13e04633da tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:56.317870 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694f1079-5299-44ad-afb6-1c13e04633da tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:56.318304 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694f1079-5299-44ad-afb6-1c13e04633da tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:56.318989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694f1079-5299-44ad-afb6-1c13e04633da tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:56.319439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694f1079-5299-44ad-afb6-1c13e04633da tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:56.319862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694f1079-5299-44ad-afb6-1c13e04633da tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:56.388895 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b1ce5767-3c74-4352-8665-3550bdf8c329 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:56.389583 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b1ce5767-3c74-4352-8665-3550bdf8c329 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:56.395859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1ce5767-3c74-4352-8665-3550bdf8c329 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:56.396375 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1ce5767-3c74-4352-8665-3550bdf8c329 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:56.397082 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1ce5767-3c74-4352-8665-3550bdf8c329 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:56.397487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1ce5767-3c74-4352-8665-3550bdf8c329 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:56.397972 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1ce5767-3c74-4352-8665-3550bdf8c329 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:56.398400 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b1ce5767-3c74-4352-8665-3550bdf8c329 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:56.454932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-694f1079-5299-44ad-afb6-1c13e04633da tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:56.462765 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-694f1079-5299-44ad-afb6-1c13e04633da tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.156250 Aug 10 16:57:56.463336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 228/457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:56 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:56.549841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b1ce5767-3c74-4352-8665-3550bdf8c329 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:56.557232 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b1ce5767-3c74-4352-8665-3550bdf8c329 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.173160 Aug 10 16:57:56.557802 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 230/458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:56 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:56.577202 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-743153772", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:57:56.628661 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:57:56.898815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:57:56.899229 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:57:56.899702 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:57:56.900107 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:57:56.900539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:57:56.909196 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:56.909673 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:56.910108 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:56.911097 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:56.911555 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:56.912006 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:56.928244 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Getting quotas for project 59727625ef364023997932413b8116f2. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:57:56.932138 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Getting quotas for user 58e2fc893e8a4424a77e0ca17f2920c6 and project 59727625ef364023997932413b8116f2. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:57:56.943724 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:57:56.946079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:57:56.990093 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4c36c730-1025-4e57-8996-3a4b51888c5e tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.417601 Aug 10 16:57:56.990746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 229/459] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:57:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 16:57:57.002361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-324dec21-e2be-4263-868b-c08fc3275f16 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:57.003085 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-324dec21-e2be-4263-868b-c08fc3275f16 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:57.028849 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2f55a742-65a4-4768-8522-94a52694629d tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f2e420d-3ae1-46d5-8bf2-3f91e5a9746c", "device": "/dev/sdb"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:57:57.031868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2f55a742-65a4-4768-8522-94a52694629d tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:57.039013 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f55a742-65a4-4768-8522-94a52694629d tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:57.039538 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f55a742-65a4-4768-8522-94a52694629d tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:57.039981 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f55a742-65a4-4768-8522-94a52694629d tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:57.040734 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f55a742-65a4-4768-8522-94a52694629d tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:57.041192 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f55a742-65a4-4768-8522-94a52694629d tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:57.041619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f55a742-65a4-4768-8522-94a52694629d tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:57.066009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-324dec21-e2be-4263-868b-c08fc3275f16 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:57.073223 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-324dec21-e2be-4263-868b-c08fc3275f16 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1214 microversion: 2.1 time: 0.074839 Aug 10 16:57:57.073793 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 231/460] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:56 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:57.484322 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-59e8d3b3-fdb4-4a32-b393-92e6cf7174ff tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:57.484940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-59e8d3b3-fdb4-4a32-b393-92e6cf7174ff tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:57.490734 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-59e8d3b3-fdb4-4a32-b393-92e6cf7174ff tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:57.491220 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-59e8d3b3-fdb4-4a32-b393-92e6cf7174ff tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:57.491678 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-59e8d3b3-fdb4-4a32-b393-92e6cf7174ff tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:57.492412 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-59e8d3b3-fdb4-4a32-b393-92e6cf7174ff tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:57.492861 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-59e8d3b3-fdb4-4a32-b393-92e6cf7174ff tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:57.493278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-59e8d3b3-fdb4-4a32-b393-92e6cf7174ff tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:57.648652 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-59e8d3b3-fdb4-4a32-b393-92e6cf7174ff tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:57.658604 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-59e8d3b3-fdb4-4a32-b393-92e6cf7174ff tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.178833 Aug 10 16:57:57.659194 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 232/461] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:57 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:57:57.670821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7e0e34a8-72f5-4a92-a18f-254d1c8eb7a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:57.671420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7e0e34a8-72f5-4a92-a18f-254d1c8eb7a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:57.677413 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e0e34a8-72f5-4a92-a18f-254d1c8eb7a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:57.677900 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e0e34a8-72f5-4a92-a18f-254d1c8eb7a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:57.678331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e0e34a8-72f5-4a92-a18f-254d1c8eb7a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:57.679017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e0e34a8-72f5-4a92-a18f-254d1c8eb7a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:57.679471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e0e34a8-72f5-4a92-a18f-254d1c8eb7a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:57.679892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e0e34a8-72f5-4a92-a18f-254d1c8eb7a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:57.725074 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2f55a742-65a4-4768-8522-94a52694629d tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "POST /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700067 Aug 10 16:57:57.726053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 230/462] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 16:57:57 2022] POST /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:57:57.830794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7e0e34a8-72f5-4a92-a18f-254d1c8eb7a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:57.838377 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7e0e34a8-72f5-4a92-a18f-254d1c8eb7a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1510 microversion: 2.1 time: 0.173436 Aug 10 16:57:57.838930 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 233/463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:57 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:58.095703 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eff3088a-0e95-4c34-9f0d-8808054e73e0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:58.096526 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eff3088a-0e95-4c34-9f0d-8808054e73e0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:58.102693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eff3088a-0e95-4c34-9f0d-8808054e73e0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:58.103183 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eff3088a-0e95-4c34-9f0d-8808054e73e0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:58.103644 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eff3088a-0e95-4c34-9f0d-8808054e73e0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:58.104349 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eff3088a-0e95-4c34-9f0d-8808054e73e0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:58.104816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eff3088a-0e95-4c34-9f0d-8808054e73e0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:58.105245 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eff3088a-0e95-4c34-9f0d-8808054e73e0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:58.167958 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-eff3088a-0e95-4c34-9f0d-8808054e73e0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:58.175268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eff3088a-0e95-4c34-9f0d-8808054e73e0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1210 microversion: 2.1 time: 0.084880 Aug 10 16:57:58.175835 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 231/464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:58 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:58.679481 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-697ee11e-559b-4fd6-8253-0f01f26f24c8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:58.680084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-697ee11e-559b-4fd6-8253-0f01f26f24c8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:58.686467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ee11e-559b-4fd6-8253-0f01f26f24c8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:58.686940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ee11e-559b-4fd6-8253-0f01f26f24c8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:58.687363 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ee11e-559b-4fd6-8253-0f01f26f24c8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:58.688065 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ee11e-559b-4fd6-8253-0f01f26f24c8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:58.688537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ee11e-559b-4fd6-8253-0f01f26f24c8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:58.688952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ee11e-559b-4fd6-8253-0f01f26f24c8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:58.815526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-697ee11e-559b-4fd6-8253-0f01f26f24c8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:58.822771 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-697ee11e-559b-4fd6-8253-0f01f26f24c8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.147091 Aug 10 16:57:58.823326 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 234/465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:58 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:58.860241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-92fd7a96-1a06-4e25-8700-922602d2e668 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:58.860850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-92fd7a96-1a06-4e25-8700-922602d2e668 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:58.867019 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92fd7a96-1a06-4e25-8700-922602d2e668 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:58.867497 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92fd7a96-1a06-4e25-8700-922602d2e668 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:58.867930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92fd7a96-1a06-4e25-8700-922602d2e668 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:58.868636 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92fd7a96-1a06-4e25-8700-922602d2e668 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:58.869092 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92fd7a96-1a06-4e25-8700-922602d2e668 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:58.869513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92fd7a96-1a06-4e25-8700-922602d2e668 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:58.995972 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-92fd7a96-1a06-4e25-8700-922602d2e668 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:59.004599 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-92fd7a96-1a06-4e25-8700-922602d2e668 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1516 microversion: 2.1 time: 0.148658 Aug 10 16:57:59.005332 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 232/466] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:58 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:59.196382 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cfe1741a-49fd-4295-954c-5fc2fa3982f2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:59.196923 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cfe1741a-49fd-4295-954c-5fc2fa3982f2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:59.202968 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfe1741a-49fd-4295-954c-5fc2fa3982f2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:59.203448 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfe1741a-49fd-4295-954c-5fc2fa3982f2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:59.203877 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfe1741a-49fd-4295-954c-5fc2fa3982f2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:59.204584 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfe1741a-49fd-4295-954c-5fc2fa3982f2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:59.205030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfe1741a-49fd-4295-954c-5fc2fa3982f2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:59.205444 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfe1741a-49fd-4295-954c-5fc2fa3982f2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:59.208379 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:59.271119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cfe1741a-49fd-4295-954c-5fc2fa3982f2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:59.285820 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cfe1741a-49fd-4295-954c-5fc2fa3982f2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1210 microversion: 2.1 time: 0.093033 Aug 10 16:57:59.286816 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 235/467] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:59 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:57:59.843288 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e9c12db1-3059-4364-9232-8437e7e2abf8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:57:59.843896 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e9c12db1-3059-4364-9232-8437e7e2abf8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:57:59.850189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9c12db1-3059-4364-9232-8437e7e2abf8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:59.850671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9c12db1-3059-4364-9232-8437e7e2abf8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:59.851105 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9c12db1-3059-4364-9232-8437e7e2abf8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:59.851789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9c12db1-3059-4364-9232-8437e7e2abf8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:57:59.852273 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9c12db1-3059-4364-9232-8437e7e2abf8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:57:59.852701 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9c12db1-3059-4364-9232-8437e7e2abf8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:57:59.979050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e9c12db1-3059-4364-9232-8437e7e2abf8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:57:59.986968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e9c12db1-3059-4364-9232-8437e7e2abf8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1313 microversion: 2.1 time: 0.147563 Aug 10 16:57:59.987523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 233/468] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:57:59 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:00.306686 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ec937557-030f-4af4-9e7f-ba1891dc6734 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:00.307266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ec937557-030f-4af4-9e7f-ba1891dc6734 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:00.319017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec937557-030f-4af4-9e7f-ba1891dc6734 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:00.319595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec937557-030f-4af4-9e7f-ba1891dc6734 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:00.320215 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec937557-030f-4af4-9e7f-ba1891dc6734 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:00.321462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec937557-030f-4af4-9e7f-ba1891dc6734 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:00.322163 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec937557-030f-4af4-9e7f-ba1891dc6734 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:00.322613 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec937557-030f-4af4-9e7f-ba1891dc6734 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:00.385709 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ec937557-030f-4af4-9e7f-ba1891dc6734 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:00.393127 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ec937557-030f-4af4-9e7f-ba1891dc6734 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1266 microversion: 2.1 time: 0.090323 Aug 10 16:58:00.393673 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 236/469] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:00 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:01.007323 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-23a11cf4-66ee-44c1-9a04-dcaabe957ef4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:01.007954 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-23a11cf4-66ee-44c1-9a04-dcaabe957ef4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:01.014972 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23a11cf4-66ee-44c1-9a04-dcaabe957ef4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:01.015451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23a11cf4-66ee-44c1-9a04-dcaabe957ef4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:01.015880 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23a11cf4-66ee-44c1-9a04-dcaabe957ef4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:01.016592 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23a11cf4-66ee-44c1-9a04-dcaabe957ef4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:01.017041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23a11cf4-66ee-44c1-9a04-dcaabe957ef4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:01.017460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23a11cf4-66ee-44c1-9a04-dcaabe957ef4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:01.151895 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-23a11cf4-66ee-44c1-9a04-dcaabe957ef4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:01.159308 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-23a11cf4-66ee-44c1-9a04-dcaabe957ef4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1496 microversion: 2.1 time: 0.155781 Aug 10 16:58:01.159882 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 234/470] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:01 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:01.420040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-47077764-c988-438c-99a5-a565897ad661 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:01.420705 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-47077764-c988-438c-99a5-a565897ad661 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:01.428965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53cc4d73-f015-4335-bc64-2fc700ef37e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Action: 'create', calling method: .version_select at 0x7f5b08731ca0>, body: {"keypair": {"name": "tempest-keypair-511194023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLENWun+lAJ941HZ6Wwn19FdWxdJBXIRxtqOS/K6j/Yhkx1o6IrW7MDywBke1MXSeZ1gcp8DicTrE8dyUYsqZg9PeGxsVNd+wfdw2IHLSByQdNSOjNTmeECdCuPwJX66A=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:01.433331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47077764-c988-438c-99a5-a565897ad661 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:01.434458 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47077764-c988-438c-99a5-a565897ad661 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:01.435158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47077764-c988-438c-99a5-a565897ad661 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:01.435833 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47077764-c988-438c-99a5-a565897ad661 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:01.436650 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47077764-c988-438c-99a5-a565897ad661 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:01.437371 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47077764-c988-438c-99a5-a565897ad661 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:01.440781 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-53cc4d73-f015-4335-bc64-2fc700ef37e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Getting quotas for project 36cf7bbfa5d3420996a2af036cf8e0da. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:58:01.444820 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-53cc4d73-f015-4335-bc64-2fc700ef37e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Getting quotas for user c7fac765624c4e0b85b01f356a14a1cb and project 36cf7bbfa5d3420996a2af036cf8e0da. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:58:01.470508 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [None req-53cc4d73-f015-4335-bc64-2fc700ef37e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [041186a9-8db1-48b5-95c5-ec23e62d7afe] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 16:58:01.512310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-47077764-c988-438c-99a5-a565897ad661 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:01.521890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-47077764-c988-438c-99a5-a565897ad661 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1266 microversion: 2.1 time: 0.110388 Aug 10 16:58:01.522737 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 237/471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:01 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:01.731244 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b2699bba-0d41-400f-8305-f843e35ff990 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:01.731742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b2699bba-0d41-400f-8305-f843e35ff990 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:01.737605 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2699bba-0d41-400f-8305-f843e35ff990 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:01.738090 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2699bba-0d41-400f-8305-f843e35ff990 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:01.738524 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2699bba-0d41-400f-8305-f843e35ff990 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:01.739210 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2699bba-0d41-400f-8305-f843e35ff990 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:01.739662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2699bba-0d41-400f-8305-f843e35ff990 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:01.740086 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2699bba-0d41-400f-8305-f843e35ff990 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:01.764584 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b2699bba-0d41-400f-8305-f843e35ff990 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 16:58:01.847387 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b2699bba-0d41-400f-8305-f843e35ff990 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 204 len: 0 microversion: 2.1 time: 0.120192 Aug 10 16:58:01.847957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 238/472] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 16:58:01 2022] DELETE /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 16:58:01.856616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-418bf300-564e-404a-9b2f-fe047781c4ea tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:01.857318 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-418bf300-564e-404a-9b2f-fe047781c4ea tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:01.862625 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-418bf300-564e-404a-9b2f-fe047781c4ea tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:01.863106 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-418bf300-564e-404a-9b2f-fe047781c4ea tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:01.863528 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-418bf300-564e-404a-9b2f-fe047781c4ea tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:01.864225 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-418bf300-564e-404a-9b2f-fe047781c4ea tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:01.864670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-418bf300-564e-404a-9b2f-fe047781c4ea tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:01.865087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-418bf300-564e-404a-9b2f-fe047781c4ea tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:01.994776 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-418bf300-564e-404a-9b2f-fe047781c4ea tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:02.002325 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-418bf300-564e-404a-9b2f-fe047781c4ea tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1502 microversion: 2.1 time: 0.149975 Aug 10 16:58:02.003624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 239/473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:01 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:02.468321 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [None req-53cc4d73-f015-4335-bc64-2fc700ef37e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [041186a9-8db1-48b5-95c5-ec23e62d7afe] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57200. Aug 10 16:58:02.481900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53cc4d73-f015-4335-bc64-2fc700ef37e5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.061092 Aug 10 16:58:02.482489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 235/474] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 10 16:58:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:58:02.545614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-07bc493d-e1e8-42ea-99f9-420d76af0731 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:02.546339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-07bc493d-e1e8-42ea-99f9-420d76af0731 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:02.552472 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07bc493d-e1e8-42ea-99f9-420d76af0731 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:02.553214 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07bc493d-e1e8-42ea-99f9-420d76af0731 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:02.553655 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07bc493d-e1e8-42ea-99f9-420d76af0731 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:02.554344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07bc493d-e1e8-42ea-99f9-420d76af0731 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:02.554824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07bc493d-e1e8-42ea-99f9-420d76af0731 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:02.555287 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07bc493d-e1e8-42ea-99f9-420d76af0731 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:02.633832 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-07bc493d-e1e8-42ea-99f9-420d76af0731 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:02.642833 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-07bc493d-e1e8-42ea-99f9-420d76af0731 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1274 microversion: 2.1 time: 0.101303 Aug 10 16:58:02.643458 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 240/475] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:02 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:03.023341 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34af6c79-9cec-4f57-9dbc-2db7a6de45d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:03.023956 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34af6c79-9cec-4f57-9dbc-2db7a6de45d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:03.032767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34af6c79-9cec-4f57-9dbc-2db7a6de45d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:03.033258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34af6c79-9cec-4f57-9dbc-2db7a6de45d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:03.033701 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34af6c79-9cec-4f57-9dbc-2db7a6de45d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:03.035939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34af6c79-9cec-4f57-9dbc-2db7a6de45d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:03.035939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34af6c79-9cec-4f57-9dbc-2db7a6de45d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:03.035939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34af6c79-9cec-4f57-9dbc-2db7a6de45d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:03.250037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-34af6c79-9cec-4f57-9dbc-2db7a6de45d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:03.257533 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-34af6c79-9cec-4f57-9dbc-2db7a6de45d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1502 microversion: 2.1 time: 0.238568 Aug 10 16:58:03.258291 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 236/476] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:03 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1502 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:03.663730 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8a8ee92d-3b55-43ad-ba24-6e1ef3e2108f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:03.664571 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8a8ee92d-3b55-43ad-ba24-6e1ef3e2108f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:03.671128 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8ee92d-3b55-43ad-ba24-6e1ef3e2108f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:03.671608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8ee92d-3b55-43ad-ba24-6e1ef3e2108f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:03.672039 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8ee92d-3b55-43ad-ba24-6e1ef3e2108f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:03.673022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8ee92d-3b55-43ad-ba24-6e1ef3e2108f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:03.673674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8ee92d-3b55-43ad-ba24-6e1ef3e2108f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:03.674098 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8ee92d-3b55-43ad-ba24-6e1ef3e2108f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:03.742943 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8a8ee92d-3b55-43ad-ba24-6e1ef3e2108f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:03.750628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8a8ee92d-3b55-43ad-ba24-6e1ef3e2108f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1284 microversion: 2.1 time: 0.090720 Aug 10 16:58:03.751184 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 241/477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:03 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:03.838312 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2146666509", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58fa7b48-111c-4ce4-8372-d8a52b5c42d3"}], "security_groups": [{"name": "tempest-securitygroup--2003457844"}], "key_name": "tempest-keypair-511194023", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:03.936670 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] validate_networks() for [('58fa7b48-111c-4ce4-8372-d8a52b5c42d3', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:58:04.278432 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-03d31e51-1b1f-4af4-bcf0-f07d34ff1893 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:04.279068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-03d31e51-1b1f-4af4-bcf0-f07d34ff1893 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:04.284879 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03d31e51-1b1f-4af4-bcf0-f07d34ff1893 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:04.285357 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03d31e51-1b1f-4af4-bcf0-f07d34ff1893 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:04.285780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03d31e51-1b1f-4af4-bcf0-f07d34ff1893 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:04.286458 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03d31e51-1b1f-4af4-bcf0-f07d34ff1893 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:04.286902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03d31e51-1b1f-4af4-bcf0-f07d34ff1893 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:04.287319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03d31e51-1b1f-4af4-bcf0-f07d34ff1893 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:04.318037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:58:04.318496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:58:04.318995 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:58:04.319406 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:58:04.319816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:58:04.329618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:04.330096 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:04.330528 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:04.331277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:04.331729 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:04.332178 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:04.348519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Getting quotas for project 36cf7bbfa5d3420996a2af036cf8e0da. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:58:04.352408 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Getting quotas for user c7fac765624c4e0b85b01f356a14a1cb and project 36cf7bbfa5d3420996a2af036cf8e0da. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:58:04.363072 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:58:04.365345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:58:04.414681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-177813e7-c6ad-42d2-8ae4-b4dee7d82bc6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.580129 Aug 10 16:58:04.415493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 237/478] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:58:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 16:58:04.420502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-03d31e51-1b1f-4af4-bcf0-f07d34ff1893 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:04.428674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b242f10-39a2-4291-a176-34722d59d71c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:04.430480 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b242f10-39a2-4291-a176-34722d59d71c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:04.430607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-03d31e51-1b1f-4af4-bcf0-f07d34ff1893 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1502 microversion: 2.1 time: 0.155474 Aug 10 16:58:04.431110 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 242/479] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:04 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:04.498551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b242f10-39a2-4291-a176-34722d59d71c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:04.505940 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b242f10-39a2-4291-a176-34722d59d71c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1245 microversion: 2.1 time: 0.082427 Aug 10 16:58:04.506521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 238/480] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:04 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:04.773019 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-459d6e47-04a6-4f50-aa65-b00106654be5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:04.773623 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-459d6e47-04a6-4f50-aa65-b00106654be5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:04.780004 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-459d6e47-04a6-4f50-aa65-b00106654be5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:04.780687 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-459d6e47-04a6-4f50-aa65-b00106654be5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:04.781119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-459d6e47-04a6-4f50-aa65-b00106654be5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:04.781804 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-459d6e47-04a6-4f50-aa65-b00106654be5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:04.782418 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-459d6e47-04a6-4f50-aa65-b00106654be5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:04.782825 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-459d6e47-04a6-4f50-aa65-b00106654be5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:04.878773 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-459d6e47-04a6-4f50-aa65-b00106654be5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:04.887072 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-459d6e47-04a6-4f50-aa65-b00106654be5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1272 microversion: 2.1 time: 0.117787 Aug 10 16:58:04.887651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 243/481] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:04 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:05.463342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5a22a70d-de92-44b1-bba6-f2cb0521375b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:05.463342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5a22a70d-de92-44b1-bba6-f2cb0521375b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:05.469395 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a22a70d-de92-44b1-bba6-f2cb0521375b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:05.470012 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a22a70d-de92-44b1-bba6-f2cb0521375b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:05.470515 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a22a70d-de92-44b1-bba6-f2cb0521375b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:05.471374 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a22a70d-de92-44b1-bba6-f2cb0521375b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:05.473708 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a22a70d-de92-44b1-bba6-f2cb0521375b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:05.474817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a22a70d-de92-44b1-bba6-f2cb0521375b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:05.526816 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1323aea4-71fb-4112-9db5-38587ad65c8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:05.527730 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1323aea4-71fb-4112-9db5-38587ad65c8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:05.534575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1323aea4-71fb-4112-9db5-38587ad65c8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:05.535204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1323aea4-71fb-4112-9db5-38587ad65c8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:05.535734 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1323aea4-71fb-4112-9db5-38587ad65c8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:05.536969 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1323aea4-71fb-4112-9db5-38587ad65c8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:05.537765 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1323aea4-71fb-4112-9db5-38587ad65c8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:05.538274 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1323aea4-71fb-4112-9db5-38587ad65c8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:05.621891 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5a22a70d-de92-44b1-bba6-f2cb0521375b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:05.632409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5a22a70d-de92-44b1-bba6-f2cb0521375b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1502 microversion: 2.1 time: 0.180246 Aug 10 16:58:05.633906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 239/482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:05 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:05.673824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1323aea4-71fb-4112-9db5-38587ad65c8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:05.682426 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1323aea4-71fb-4112-9db5-38587ad65c8f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1297 microversion: 2.1 time: 0.159567 Aug 10 16:58:05.683083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 244/483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:05 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1297 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:05.818879 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f8e532cc-c2b8-448b-88a1-bc9090b7d83e req-8ee4ec04-e97a-4943-ab84-a9855c611a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eff2519-521a-448f-9e2d-c449080ca49c", "name": "network-vif-deleted", "tag": "ab9f62b5-4500-4eb8-9e41-5befea412bc3"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:05.829373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f8e532cc-c2b8-448b-88a1-bc9090b7d83e req-8ee4ec04-e97a-4943-ab84-a9855c611a66 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:05.830132 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f8e532cc-c2b8-448b-88a1-bc9090b7d83e req-8ee4ec04-e97a-4943-ab84-a9855c611a66 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:05.830843 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f8e532cc-c2b8-448b-88a1-bc9090b7d83e req-8ee4ec04-e97a-4943-ab84-a9855c611a66 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:05.844190 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f8e532cc-c2b8-448b-88a1-bc9090b7d83e req-8ee4ec04-e97a-4943-ab84-a9855c611a66 service nova] Creating event network-vif-deleted:ab9f62b5-4500-4eb8-9e41-5befea412bc3 for instance 3eff2519-521a-448f-9e2d-c449080ca49c on hv-cinder-83602 Aug 10 16:58:05.851909 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f8e532cc-c2b8-448b-88a1-bc9090b7d83e req-8ee4ec04-e97a-4943-ab84-a9855c611a66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036622 Aug 10 16:58:05.853196 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 240/484] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:58:05.909756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-048bd68d-9bc2-4ee2-a3b8-5be42fca216a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:05.910465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-048bd68d-9bc2-4ee2-a3b8-5be42fca216a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:05.916400 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-048bd68d-9bc2-4ee2-a3b8-5be42fca216a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:05.916957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-048bd68d-9bc2-4ee2-a3b8-5be42fca216a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:05.917475 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-048bd68d-9bc2-4ee2-a3b8-5be42fca216a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:05.918257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-048bd68d-9bc2-4ee2-a3b8-5be42fca216a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:05.918800 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-048bd68d-9bc2-4ee2-a3b8-5be42fca216a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:05.919409 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-048bd68d-9bc2-4ee2-a3b8-5be42fca216a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:06.003495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-048bd68d-9bc2-4ee2-a3b8-5be42fca216a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:06.012863 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-048bd68d-9bc2-4ee2-a3b8-5be42fca216a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1272 microversion: 2.1 time: 0.106862 Aug 10 16:58:06.013977 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 245/485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:05 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:06.656037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:06.657393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:06.661553 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:06.667293 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:06.668194 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:06.668810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:06.670268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:06.671087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:06.671687 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:06.692806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:06.705255 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ecd8c24d-d3bd-400b-a25f-cde949cfd0a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:06.706248 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ecd8c24d-d3bd-400b-a25f-cde949cfd0a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:06.711090 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:06.711875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:06.712573 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:06.713484 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lazy-loading 'fault' on Instance uuid 3eff2519-521a-448f-9e2d-c449080ca49c {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:58:06.716915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecd8c24d-d3bd-400b-a25f-cde949cfd0a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:06.718045 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecd8c24d-d3bd-400b-a25f-cde949cfd0a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:06.718963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecd8c24d-d3bd-400b-a25f-cde949cfd0a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:06.720002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecd8c24d-d3bd-400b-a25f-cde949cfd0a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:06.720891 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecd8c24d-d3bd-400b-a25f-cde949cfd0a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:06.721514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecd8c24d-d3bd-400b-a25f-cde949cfd0a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:06.807605 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:06.818291 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eb723e23-9a10-475e-8ef7-89c16a06053b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1303 microversion: 2.1 time: 0.167223 Aug 10 16:58:06.834351 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 241/486] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:06 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:06.936480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ecd8c24d-d3bd-400b-a25f-cde949cfd0a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:06.944305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ecd8c24d-d3bd-400b-a25f-cde949cfd0a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.245207 Aug 10 16:58:06.944895 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 246/487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:06 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:07.033799 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3311b08c-c110-4954-9d2c-7715e7134538 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:07.034415 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3311b08c-c110-4954-9d2c-7715e7134538 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:07.040299 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3311b08c-c110-4954-9d2c-7715e7134538 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:07.040791 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3311b08c-c110-4954-9d2c-7715e7134538 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:07.041227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3311b08c-c110-4954-9d2c-7715e7134538 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:07.041918 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3311b08c-c110-4954-9d2c-7715e7134538 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:07.042372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3311b08c-c110-4954-9d2c-7715e7134538 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:07.043026 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3311b08c-c110-4954-9d2c-7715e7134538 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:07.168967 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-3311b08c-c110-4954-9d2c-7715e7134538 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:07.176138 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3311b08c-c110-4954-9d2c-7715e7134538 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.146242 Aug 10 16:58:07.176722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 242/488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:07 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:07.842719 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:07.843339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:07.845252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:07.850590 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:07.851063 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:07.851487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:07.852168 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:07.852629 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:07.853043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:07.876681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-2fcf03a6-1c8c-4fce-9704-a10d9d2dd2d5 req-b9c33945-e24b-4b60-895e-d556805ffd73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c067dba5-55d9-421c-badd-f6829a136d59", "tag": "08bdac8b-67f5-4f63-882d-658131e050a5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:07.883766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:07.884305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:07.884738 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:07.885179 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lazy-loading 'fault' on Instance uuid 3eff2519-521a-448f-9e2d-c449080ca49c {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:58:07.886883 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2fcf03a6-1c8c-4fce-9704-a10d9d2dd2d5 req-b9c33945-e24b-4b60-895e-d556805ffd73 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:07.887356 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2fcf03a6-1c8c-4fce-9704-a10d9d2dd2d5 req-b9c33945-e24b-4b60-895e-d556805ffd73 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:07.887789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2fcf03a6-1c8c-4fce-9704-a10d9d2dd2d5 req-b9c33945-e24b-4b60-895e-d556805ffd73 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:07.898217 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-2fcf03a6-1c8c-4fce-9704-a10d9d2dd2d5 req-b9c33945-e24b-4b60-895e-d556805ffd73 service nova] Creating event network-changed:08bdac8b-67f5-4f63-882d-658131e050a5 for instance c067dba5-55d9-421c-badd-f6829a136d59 on hv-cinder-83602 Aug 10 16:58:07.903233 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-2fcf03a6-1c8c-4fce-9704-a10d9d2dd2d5 req-b9c33945-e24b-4b60-895e-d556805ffd73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030128 Aug 10 16:58:07.904348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 243/489] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:58:07.928925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:07.936291 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2c85d315-0f9c-4050-a072-94d6725daf69 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1303 microversion: 2.1 time: 0.097942 Aug 10 16:58:07.936766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 247/490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:07 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:07.966860 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a903b6cc-a59c-45b9-89f9-2223650c5b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:07.967574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a903b6cc-a59c-45b9-89f9-2223650c5b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:07.973676 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a903b6cc-a59c-45b9-89f9-2223650c5b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:07.974159 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a903b6cc-a59c-45b9-89f9-2223650c5b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:07.974592 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a903b6cc-a59c-45b9-89f9-2223650c5b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:07.975279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a903b6cc-a59c-45b9-89f9-2223650c5b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:07.975732 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a903b6cc-a59c-45b9-89f9-2223650c5b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:07.976195 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a903b6cc-a59c-45b9-89f9-2223650c5b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:08.117376 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a903b6cc-a59c-45b9-89f9-2223650c5b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:08.124603 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a903b6cc-a59c-45b9-89f9-2223650c5b63 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.162377 Aug 10 16:58:08.125157 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 244/491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:07 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:08.196883 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4ae02930-ff7a-438c-8c55-cffc7ce04508 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:08.197424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4ae02930-ff7a-438c-8c55-cffc7ce04508 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:08.203880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ae02930-ff7a-438c-8c55-cffc7ce04508 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:08.204414 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ae02930-ff7a-438c-8c55-cffc7ce04508 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:08.204847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ae02930-ff7a-438c-8c55-cffc7ce04508 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:08.205532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ae02930-ff7a-438c-8c55-cffc7ce04508 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:08.205981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ae02930-ff7a-438c-8c55-cffc7ce04508 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:08.206404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ae02930-ff7a-438c-8c55-cffc7ce04508 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:08.330204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4ae02930-ff7a-438c-8c55-cffc7ce04508 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:08.337844 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4ae02930-ff7a-438c-8c55-cffc7ce04508 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.144848 Aug 10 16:58:08.338405 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 248/492] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:08 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:08.956174 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:08.956795 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:08.963406 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:08.963886 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:08.964356 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:08.965040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:08.965490 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:08.965912 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:08.996037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:08.996545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:08.996982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:08.998056 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lazy-loading 'fault' on Instance uuid 3eff2519-521a-448f-9e2d-c449080ca49c {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:58:09.036532 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:09.043675 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4e8251d2-f5af-4111-84c7-be8afbdcec8b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1303 microversion: 2.1 time: 0.091416 Aug 10 16:58:09.044803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 245/493] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:08 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:09.144591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ed997132-e4aa-41c4-820b-4c747a53b384 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:09.145213 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ed997132-e4aa-41c4-820b-4c747a53b384 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:09.151129 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed997132-e4aa-41c4-820b-4c747a53b384 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:09.151604 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed997132-e4aa-41c4-820b-4c747a53b384 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:09.152032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed997132-e4aa-41c4-820b-4c747a53b384 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:09.152726 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed997132-e4aa-41c4-820b-4c747a53b384 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:09.153173 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed997132-e4aa-41c4-820b-4c747a53b384 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:09.153586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed997132-e4aa-41c4-820b-4c747a53b384 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:09.281536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ed997132-e4aa-41c4-820b-4c747a53b384 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:09.283654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:09.290054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ed997132-e4aa-41c4-820b-4c747a53b384 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.149286 Aug 10 16:58:09.290614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 249/494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:09 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:09.359154 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d9969bde-b2a5-4d4e-b46f-60dbbf2b26db tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:09.359750 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d9969bde-b2a5-4d4e-b46f-60dbbf2b26db tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:09.365880 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9969bde-b2a5-4d4e-b46f-60dbbf2b26db tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:09.366355 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9969bde-b2a5-4d4e-b46f-60dbbf2b26db tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:09.366782 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9969bde-b2a5-4d4e-b46f-60dbbf2b26db tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:09.367462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9969bde-b2a5-4d4e-b46f-60dbbf2b26db tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:09.367910 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9969bde-b2a5-4d4e-b46f-60dbbf2b26db tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:09.368362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9969bde-b2a5-4d4e-b46f-60dbbf2b26db tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:09.491275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9969bde-b2a5-4d4e-b46f-60dbbf2b26db tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:09.498835 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d9969bde-b2a5-4d4e-b46f-60dbbf2b26db tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.144047 Aug 10 16:58:09.499407 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 246/495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:09 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:10.067698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:10.069100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:10.077318 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:10.077868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:10.078392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:10.079235 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:10.080030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:10.080448 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:10.117780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:10.118267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:10.118700 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:10.119148 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lazy-loading 'fault' on Instance uuid 3eff2519-521a-448f-9e2d-c449080ca49c {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:58:10.159444 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:10.166772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ad686f9c-0814-409b-ac7a-c5f184d3c48d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 200 len: 1303 microversion: 2.1 time: 0.104278 Aug 10 16:58:10.167331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 250/496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:10 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:10.311256 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7777cdfe-d6d4-4f1b-912b-e7e6920be969 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:10.311865 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7777cdfe-d6d4-4f1b-912b-e7e6920be969 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:10.318350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7777cdfe-d6d4-4f1b-912b-e7e6920be969 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:10.318776 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7777cdfe-d6d4-4f1b-912b-e7e6920be969 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:10.319229 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7777cdfe-d6d4-4f1b-912b-e7e6920be969 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:10.319895 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7777cdfe-d6d4-4f1b-912b-e7e6920be969 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:10.320479 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7777cdfe-d6d4-4f1b-912b-e7e6920be969 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:10.320899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7777cdfe-d6d4-4f1b-912b-e7e6920be969 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:10.519150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9c034bc1-4170-49f3-970e-af299ae6cd65 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:10.519977 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9c034bc1-4170-49f3-970e-af299ae6cd65 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:10.526334 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7777cdfe-d6d4-4f1b-912b-e7e6920be969 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:10.529177 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c034bc1-4170-49f3-970e-af299ae6cd65 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:10.529674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c034bc1-4170-49f3-970e-af299ae6cd65 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:10.530104 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c034bc1-4170-49f3-970e-af299ae6cd65 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:10.530802 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c034bc1-4170-49f3-970e-af299ae6cd65 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:10.531245 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c034bc1-4170-49f3-970e-af299ae6cd65 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:10.532411 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c034bc1-4170-49f3-970e-af299ae6cd65 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:10.539859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7777cdfe-d6d4-4f1b-912b-e7e6920be969 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.232864 Aug 10 16:58:10.555311 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 247/497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:10 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:10.737766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9c034bc1-4170-49f3-970e-af299ae6cd65 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:10.749530 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9c034bc1-4170-49f3-970e-af299ae6cd65 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.234375 Aug 10 16:58:10.751453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 251/498] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:10 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:11.187325 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:11.188203 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: 3eff2519-521a-448f-9e2d-c449080ca49c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:11.194554 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:11.195152 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:11.195711 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:11.196639 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:11.198240 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:11.198709 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:11.213233 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] HTTP exception thrown: Instance 3eff2519-521a-448f-9e2d-c449080ca49c could not be found. Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Request method failure captured: Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c HTTP/1.1 Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-N01IZSPy2E_i8Ya5gfknCxVwJSJofAnLxqdKs5Z9K9k24DEJN0MFcxKd0kbQ38z99r45y3WEWP7SMiaVNYbGtzBgCXOg2fgmSbCvx3yamYXbVfOION7j-ivzosMxlx1zeWeGQJ4D5kKbp9tdtFBuE4MiI0q7VA9mEMOAMOzxSeWFc Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: abe3003a0c91471e9982327ac5e17b9e Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesActionsTest-1698967808 Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 16:58:11.215139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_abe3003a0c91471e9982327ac5e17b9e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abe3003a0c91471e9982327ac5e17b9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abe3003a0c91471e9982327ac5e17b9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/abe3003a0c91471e9982327ac5e17b9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-VolumesActionsTest-1698967808 Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: abe3003a0c91471e9982327ac5e17b9e Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesActionsTest-1698967808 Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-VolumesActionsTest-1698967808-project Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 5d1f341b9aff4b7db13e429b86ba145e Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-VolumesActionsTest-1698967808-project Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 3eff2519-521a-448f-9e2d-c449080ca49c could not be found. Aug 10 16:58:11.217348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '3eff2519-521a-448f-9e2d-c449080ca49c'} Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eff2519-521a-448f-9e2d-c449080ca49c could not be found. Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:58:11.218258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eff2519-521a-448f-9e2d-c449080ca49c could not be found. Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eff2519-521a-448f-9e2d-c449080ca49c could not be found. Aug 10 16:58:11.219610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 16:58:11.220951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Returning 404 to user: Instance 3eff2519-521a-448f-9e2d-c449080ca49c could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:58:11.220951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-db01d621-be46-4cee-8a41-3bd834ac95d5 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c" status: 404 len: 111 microversion: 2.1 time: 0.034214 Aug 10 16:58:11.220951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 248/499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:11 2022] GET /compute/v2.1/servers/3eff2519-521a-448f-9e2d-c449080ca49c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:58:11.311983 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-42641e4a-ad47-484d-8b1f-69f79e8392f2 req-d094a9c5-1dce-4c0f-a47e-1cacb44a7184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e3c08d-8649-4c99-8c7c-a57166ebc96b", "tag": "6d51b077-087c-428f-af01-0240852d1af2"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:11.321829 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-42641e4a-ad47-484d-8b1f-69f79e8392f2 req-d094a9c5-1dce-4c0f-a47e-1cacb44a7184 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:11.321983 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-42641e4a-ad47-484d-8b1f-69f79e8392f2 req-d094a9c5-1dce-4c0f-a47e-1cacb44a7184 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:11.322595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-42641e4a-ad47-484d-8b1f-69f79e8392f2 req-d094a9c5-1dce-4c0f-a47e-1cacb44a7184 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:11.337527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-42641e4a-ad47-484d-8b1f-69f79e8392f2 req-d094a9c5-1dce-4c0f-a47e-1cacb44a7184 service nova] Creating event network-changed:6d51b077-087c-428f-af01-0240852d1af2 for instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b on hv-cinder-83602 Aug 10 16:58:11.344656 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-42641e4a-ad47-484d-8b1f-69f79e8392f2 req-d094a9c5-1dce-4c0f-a47e-1cacb44a7184 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036664 Aug 10 16:58:11.345591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 252/500] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:58:11.386914 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-118051794", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "networks": [{"uuid": "dc6dd6ea-0c81-4f11-974d-bb9657470b34"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:11.439371 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] validate_networks() for [('dc6dd6ea-0c81-4f11-974d-bb9657470b34', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:58:11.562309 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a0375e51-6378-4c6b-b632-e34f1355d240 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:11.563024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a0375e51-6378-4c6b-b632-e34f1355d240 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:11.569445 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0375e51-6378-4c6b-b632-e34f1355d240 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:11.570029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0375e51-6378-4c6b-b632-e34f1355d240 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:11.570533 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0375e51-6378-4c6b-b632-e34f1355d240 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:11.571422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0375e51-6378-4c6b-b632-e34f1355d240 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:11.571945 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0375e51-6378-4c6b-b632-e34f1355d240 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:11.572484 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0375e51-6378-4c6b-b632-e34f1355d240 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:11.702476 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a0375e51-6378-4c6b-b632-e34f1355d240 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:11.710205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a0375e51-6378-4c6b-b632-e34f1355d240 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.151980 Aug 10 16:58:11.710855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 253/501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:11 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:11.772287 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3f667e2e-30af-4ef5-8a3e-3b1054c87712 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:11.773372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3f667e2e-30af-4ef5-8a3e-3b1054c87712 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:11.776867 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:11.786433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f667e2e-30af-4ef5-8a3e-3b1054c87712 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:11.787004 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f667e2e-30af-4ef5-8a3e-3b1054c87712 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:11.787451 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f667e2e-30af-4ef5-8a3e-3b1054c87712 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:11.788847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f667e2e-30af-4ef5-8a3e-3b1054c87712 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:11.789568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f667e2e-30af-4ef5-8a3e-3b1054c87712 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:11.790071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f667e2e-30af-4ef5-8a3e-3b1054c87712 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:11.801810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:58:11.802238 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:58:11.802713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:58:11.803470 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:58:11.803936 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:58:11.815490 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:11.815968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:11.816421 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:11.817136 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:11.817583 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:11.818664 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:11.838063 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Getting quotas for project abe3003a0c91471e9982327ac5e17b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:58:11.845599 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Getting quotas for user 5d1f341b9aff4b7db13e429b86ba145e and project abe3003a0c91471e9982327ac5e17b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:58:11.859853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:58:11.863349 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:58:11.910495 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12b74919-25cd-471e-833c-46f38f3f5180 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527334 Aug 10 16:58:11.911303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 249/502] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:58:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 16:58:11.921771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f17cb74-b748-4769-86cb-7069c4186699 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:11.923060 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4f17cb74-b748-4769-86cb-7069c4186699 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:11.941835 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3f667e2e-30af-4ef5-8a3e-3b1054c87712 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:11.949850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3f667e2e-30af-4ef5-8a3e-3b1054c87712 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.182452 Aug 10 16:58:11.951050 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 254/503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:11 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:11.982102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4f17cb74-b748-4769-86cb-7069c4186699 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:11.989910 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f17cb74-b748-4769-86cb-7069c4186699 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1213 microversion: 2.1 time: 0.071836 Aug 10 16:58:11.990500 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 250/504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:11 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:12.729923 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b8f8953c-7cfb-411f-b329-d287e392d659 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:12.730559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b8f8953c-7cfb-411f-b329-d287e392d659 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:12.736562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8f8953c-7cfb-411f-b329-d287e392d659 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:12.737039 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8f8953c-7cfb-411f-b329-d287e392d659 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:12.737469 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8f8953c-7cfb-411f-b329-d287e392d659 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:12.738150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8f8953c-7cfb-411f-b329-d287e392d659 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:12.738597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8f8953c-7cfb-411f-b329-d287e392d659 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:12.739016 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8f8953c-7cfb-411f-b329-d287e392d659 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:12.865162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b8f8953c-7cfb-411f-b329-d287e392d659 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:12.872429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b8f8953c-7cfb-411f-b329-d287e392d659 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.146274 Aug 10 16:58:12.872985 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 255/505] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:12 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:12.971404 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4cd6f960-6dae-4029-bc72-33f1c4b9289a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:12.972003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4cd6f960-6dae-4029-bc72-33f1c4b9289a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:12.978339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cd6f960-6dae-4029-bc72-33f1c4b9289a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:12.978818 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cd6f960-6dae-4029-bc72-33f1c4b9289a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:12.979247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cd6f960-6dae-4029-bc72-33f1c4b9289a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:12.979979 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cd6f960-6dae-4029-bc72-33f1c4b9289a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:12.980445 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cd6f960-6dae-4029-bc72-33f1c4b9289a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:12.980870 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cd6f960-6dae-4029-bc72-33f1c4b9289a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:13.011213 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-06713074-4aaf-4845-8cf6-3a5ab7f47f85 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:13.011825 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-06713074-4aaf-4845-8cf6-3a5ab7f47f85 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:13.018275 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06713074-4aaf-4845-8cf6-3a5ab7f47f85 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:13.018751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06713074-4aaf-4845-8cf6-3a5ab7f47f85 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:13.019176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06713074-4aaf-4845-8cf6-3a5ab7f47f85 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:13.019857 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06713074-4aaf-4845-8cf6-3a5ab7f47f85 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:13.020331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06713074-4aaf-4845-8cf6-3a5ab7f47f85 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:13.020743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06713074-4aaf-4845-8cf6-3a5ab7f47f85 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:13.081893 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-06713074-4aaf-4845-8cf6-3a5ab7f47f85 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:13.089558 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-06713074-4aaf-4845-8cf6-3a5ab7f47f85 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1217 microversion: 2.1 time: 0.082724 Aug 10 16:58:13.090121 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 256/506] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:13 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:13.114040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4cd6f960-6dae-4029-bc72-33f1c4b9289a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:13.121510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4cd6f960-6dae-4029-bc72-33f1c4b9289a tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.153852 Aug 10 16:58:13.122071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 251/507] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:12 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:13.892663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bd0b1c73-85df-4126-a184-78cf9733d1fc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:13.893269 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bd0b1c73-85df-4126-a184-78cf9733d1fc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:13.899324 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd0b1c73-85df-4126-a184-78cf9733d1fc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:13.899806 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd0b1c73-85df-4126-a184-78cf9733d1fc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:13.900265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd0b1c73-85df-4126-a184-78cf9733d1fc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:13.900952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd0b1c73-85df-4126-a184-78cf9733d1fc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:13.901393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd0b1c73-85df-4126-a184-78cf9733d1fc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:13.901807 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd0b1c73-85df-4126-a184-78cf9733d1fc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:14.031510 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bd0b1c73-85df-4126-a184-78cf9733d1fc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:14.038786 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bd0b1c73-85df-4126-a184-78cf9733d1fc tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.149932 Aug 10 16:58:14.039325 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 257/508] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:13 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:14.113627 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06f23f49-08ab-4b5f-bc5d-7b66e6f0673b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:14.114279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-06f23f49-08ab-4b5f-bc5d-7b66e6f0673b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:14.120826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f23f49-08ab-4b5f-bc5d-7b66e6f0673b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:14.121311 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f23f49-08ab-4b5f-bc5d-7b66e6f0673b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:14.121741 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f23f49-08ab-4b5f-bc5d-7b66e6f0673b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:14.122432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f23f49-08ab-4b5f-bc5d-7b66e6f0673b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:14.122923 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f23f49-08ab-4b5f-bc5d-7b66e6f0673b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:14.123345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f23f49-08ab-4b5f-bc5d-7b66e6f0673b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:14.142164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fbf0a59f-6902-42d3-bb02-ab818221b764 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:14.142772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fbf0a59f-6902-42d3-bb02-ab818221b764 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:14.148688 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbf0a59f-6902-42d3-bb02-ab818221b764 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:14.149171 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbf0a59f-6902-42d3-bb02-ab818221b764 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:14.149603 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbf0a59f-6902-42d3-bb02-ab818221b764 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:14.150285 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbf0a59f-6902-42d3-bb02-ab818221b764 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:14.150732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbf0a59f-6902-42d3-bb02-ab818221b764 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:14.151150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbf0a59f-6902-42d3-bb02-ab818221b764 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:14.185804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-06f23f49-08ab-4b5f-bc5d-7b66e6f0673b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:14.193290 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-06f23f49-08ab-4b5f-bc5d-7b66e6f0673b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1217 microversion: 2.1 time: 0.086935 Aug 10 16:58:14.193854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 252/509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:14 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:14.280086 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fbf0a59f-6902-42d3-bb02-ab818221b764 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:14.287372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fbf0a59f-6902-42d3-bb02-ab818221b764 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.148954 Aug 10 16:58:14.287927 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 258/510] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:14 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:15.060591 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28d79763-117f-4900-ba0f-e85d0f531ae7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:15.061789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28d79763-117f-4900-ba0f-e85d0f531ae7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:15.067662 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28d79763-117f-4900-ba0f-e85d0f531ae7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:15.068139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28d79763-117f-4900-ba0f-e85d0f531ae7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:15.068597 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28d79763-117f-4900-ba0f-e85d0f531ae7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:15.069281 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28d79763-117f-4900-ba0f-e85d0f531ae7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:15.069724 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28d79763-117f-4900-ba0f-e85d0f531ae7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:15.070144 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28d79763-117f-4900-ba0f-e85d0f531ae7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:15.198562 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-28d79763-117f-4900-ba0f-e85d0f531ae7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:15.205823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28d79763-117f-4900-ba0f-e85d0f531ae7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.149274 Aug 10 16:58:15.206375 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 253/511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:15 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:15.214315 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-09f925bf-8341-49aa-a933-b7bbafed8e9d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:15.214916 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-09f925bf-8341-49aa-a933-b7bbafed8e9d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:15.220912 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-09f925bf-8341-49aa-a933-b7bbafed8e9d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:15.221391 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-09f925bf-8341-49aa-a933-b7bbafed8e9d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:15.221838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-09f925bf-8341-49aa-a933-b7bbafed8e9d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:15.222514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-09f925bf-8341-49aa-a933-b7bbafed8e9d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:15.222956 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-09f925bf-8341-49aa-a933-b7bbafed8e9d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:15.223369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-09f925bf-8341-49aa-a933-b7bbafed8e9d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:15.281842 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-09f925bf-8341-49aa-a933-b7bbafed8e9d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:15.288944 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-09f925bf-8341-49aa-a933-b7bbafed8e9d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1217 microversion: 2.1 time: 0.078445 Aug 10 16:58:15.289500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 259/512] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:15 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:15.306933 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-007fe0ae-893b-47c8-a04d-1da1a6dbee61 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:15.307643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-007fe0ae-893b-47c8-a04d-1da1a6dbee61 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:15.314337 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-007fe0ae-893b-47c8-a04d-1da1a6dbee61 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:15.314819 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-007fe0ae-893b-47c8-a04d-1da1a6dbee61 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:15.315251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-007fe0ae-893b-47c8-a04d-1da1a6dbee61 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:15.315933 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-007fe0ae-893b-47c8-a04d-1da1a6dbee61 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:15.316418 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-007fe0ae-893b-47c8-a04d-1da1a6dbee61 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:15.316840 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-007fe0ae-893b-47c8-a04d-1da1a6dbee61 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:15.441233 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-007fe0ae-893b-47c8-a04d-1da1a6dbee61 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:15.448552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-007fe0ae-893b-47c8-a04d-1da1a6dbee61 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.145386 Aug 10 16:58:15.449115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 254/513] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:15 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:16.226645 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-802b2266-7860-45ef-86bc-9654bc79a292 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:16.227164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-802b2266-7860-45ef-86bc-9654bc79a292 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:16.233301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-802b2266-7860-45ef-86bc-9654bc79a292 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:16.233848 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-802b2266-7860-45ef-86bc-9654bc79a292 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:16.234276 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-802b2266-7860-45ef-86bc-9654bc79a292 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:16.234952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-802b2266-7860-45ef-86bc-9654bc79a292 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:16.235426 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-802b2266-7860-45ef-86bc-9654bc79a292 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:16.235891 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-802b2266-7860-45ef-86bc-9654bc79a292 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:16.310300 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f933af28-2d70-492a-bc48-27531a215248 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:16.310897 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f933af28-2d70-492a-bc48-27531a215248 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:16.317361 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f933af28-2d70-492a-bc48-27531a215248 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:16.317849 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f933af28-2d70-492a-bc48-27531a215248 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:16.318276 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f933af28-2d70-492a-bc48-27531a215248 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:16.318965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f933af28-2d70-492a-bc48-27531a215248 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:16.319415 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f933af28-2d70-492a-bc48-27531a215248 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:16.319833 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f933af28-2d70-492a-bc48-27531a215248 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:16.368077 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-802b2266-7860-45ef-86bc-9654bc79a292 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:16.375904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-802b2266-7860-45ef-86bc-9654bc79a292 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.153213 Aug 10 16:58:16.376499 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 260/514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:16 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:16.383221 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f933af28-2d70-492a-bc48-27531a215248 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:16.391897 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f933af28-2d70-492a-bc48-27531a215248 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1217 microversion: 2.1 time: 0.086025 Aug 10 16:58:16.392505 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 255/515] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:16 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:16.468686 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0954d624-bac9-4131-affc-3d2c63351a02 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:16.469286 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0954d624-bac9-4131-affc-3d2c63351a02 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:16.475222 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0954d624-bac9-4131-affc-3d2c63351a02 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:16.475713 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0954d624-bac9-4131-affc-3d2c63351a02 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:16.476198 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0954d624-bac9-4131-affc-3d2c63351a02 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:16.476965 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0954d624-bac9-4131-affc-3d2c63351a02 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:16.477351 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0954d624-bac9-4131-affc-3d2c63351a02 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:16.477799 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0954d624-bac9-4131-affc-3d2c63351a02 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:16.607651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0954d624-bac9-4131-affc-3d2c63351a02 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:16.614987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0954d624-bac9-4131-affc-3d2c63351a02 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.150144 Aug 10 16:58:16.615549 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 261/516] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:16 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:17.397509 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d86b4fd9-ca01-4e9a-97cb-c9cd82a4c242 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:17.398027 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d86b4fd9-ca01-4e9a-97cb-c9cd82a4c242 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:17.405208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d86b4fd9-ca01-4e9a-97cb-c9cd82a4c242 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:17.405560 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d86b4fd9-ca01-4e9a-97cb-c9cd82a4c242 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:17.406045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d86b4fd9-ca01-4e9a-97cb-c9cd82a4c242 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:17.406746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d86b4fd9-ca01-4e9a-97cb-c9cd82a4c242 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:17.411740 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d86b4fd9-ca01-4e9a-97cb-c9cd82a4c242 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:17.411740 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d86b4fd9-ca01-4e9a-97cb-c9cd82a4c242 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:17.412333 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d1361a0f-7740-4ab0-adc9-74094f4421d6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:17.412949 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d1361a0f-7740-4ab0-adc9-74094f4421d6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:17.418785 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1361a0f-7740-4ab0-adc9-74094f4421d6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:17.419266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1361a0f-7740-4ab0-adc9-74094f4421d6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:17.419702 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1361a0f-7740-4ab0-adc9-74094f4421d6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:17.420415 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1361a0f-7740-4ab0-adc9-74094f4421d6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:17.420864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1361a0f-7740-4ab0-adc9-74094f4421d6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:17.421279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d1361a0f-7740-4ab0-adc9-74094f4421d6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:17.484996 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d1361a0f-7740-4ab0-adc9-74094f4421d6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:17.492210 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d1361a0f-7740-4ab0-adc9-74094f4421d6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1217 microversion: 2.1 time: 0.083867 Aug 10 16:58:17.492767 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 262/517] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:17 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:17.541231 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d86b4fd9-ca01-4e9a-97cb-c9cd82a4c242 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:17.548617 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d86b4fd9-ca01-4e9a-97cb-c9cd82a4c242 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.155047 Aug 10 16:58:17.549182 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 256/518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:17 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:17.636188 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cffda5d7-451c-4edb-8ba9-e65cf4f66965 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:17.636860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cffda5d7-451c-4edb-8ba9-e65cf4f66965 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:17.643849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cffda5d7-451c-4edb-8ba9-e65cf4f66965 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:17.644380 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cffda5d7-451c-4edb-8ba9-e65cf4f66965 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:17.644815 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cffda5d7-451c-4edb-8ba9-e65cf4f66965 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:17.645504 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cffda5d7-451c-4edb-8ba9-e65cf4f66965 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:17.645959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cffda5d7-451c-4edb-8ba9-e65cf4f66965 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:17.646386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cffda5d7-451c-4edb-8ba9-e65cf4f66965 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:17.784334 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cffda5d7-451c-4edb-8ba9-e65cf4f66965 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:17.791548 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cffda5d7-451c-4edb-8ba9-e65cf4f66965 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.159163 Aug 10 16:58:17.792105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 263/519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:17 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:18.513023 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5a9a8239-fa3f-4632-be4c-4a1162c06fcc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:18.513732 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5a9a8239-fa3f-4632-be4c-4a1162c06fcc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:18.520110 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a9a8239-fa3f-4632-be4c-4a1162c06fcc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:18.520618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a9a8239-fa3f-4632-be4c-4a1162c06fcc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:18.521048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a9a8239-fa3f-4632-be4c-4a1162c06fcc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:18.521730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a9a8239-fa3f-4632-be4c-4a1162c06fcc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:18.522177 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a9a8239-fa3f-4632-be4c-4a1162c06fcc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:18.522593 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a9a8239-fa3f-4632-be4c-4a1162c06fcc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:18.569042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-718ae58e-6114-4036-a5e0-059156e5c4d4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:18.569645 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-718ae58e-6114-4036-a5e0-059156e5c4d4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:18.576047 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-718ae58e-6114-4036-a5e0-059156e5c4d4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:18.576797 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-718ae58e-6114-4036-a5e0-059156e5c4d4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:18.577766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-718ae58e-6114-4036-a5e0-059156e5c4d4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:18.578451 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-718ae58e-6114-4036-a5e0-059156e5c4d4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:18.578895 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-718ae58e-6114-4036-a5e0-059156e5c4d4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:18.579311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-718ae58e-6114-4036-a5e0-059156e5c4d4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:18.582959 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5a9a8239-fa3f-4632-be4c-4a1162c06fcc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:18.590555 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5a9a8239-fa3f-4632-be4c-4a1162c06fcc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1217 microversion: 2.1 time: 0.081442 Aug 10 16:58:18.591122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 257/520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:18 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:18.705264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-718ae58e-6114-4036-a5e0-059156e5c4d4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:18.712741 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-718ae58e-6114-4036-a5e0-059156e5c4d4 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.147472 Aug 10 16:58:18.713297 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 264/521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:18 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:18.811801 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d57c4f5d-3581-47c2-a1d1-0c88655763b2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:18.812442 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d57c4f5d-3581-47c2-a1d1-0c88655763b2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:18.818319 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d57c4f5d-3581-47c2-a1d1-0c88655763b2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:18.818807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d57c4f5d-3581-47c2-a1d1-0c88655763b2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:18.819246 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d57c4f5d-3581-47c2-a1d1-0c88655763b2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:18.819939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d57c4f5d-3581-47c2-a1d1-0c88655763b2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:18.820427 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d57c4f5d-3581-47c2-a1d1-0c88655763b2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:18.820854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d57c4f5d-3581-47c2-a1d1-0c88655763b2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:18.944375 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d57c4f5d-3581-47c2-a1d1-0c88655763b2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:18.952815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d57c4f5d-3581-47c2-a1d1-0c88655763b2 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.144853 Aug 10 16:58:18.953317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 258/522] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:18 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:19.610940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f30e95f7-aa6f-41ce-b390-0c8bbb842205 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:19.611462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f30e95f7-aa6f-41ce-b390-0c8bbb842205 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:19.617514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f30e95f7-aa6f-41ce-b390-0c8bbb842205 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:19.617992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f30e95f7-aa6f-41ce-b390-0c8bbb842205 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:19.618420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f30e95f7-aa6f-41ce-b390-0c8bbb842205 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:19.619101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f30e95f7-aa6f-41ce-b390-0c8bbb842205 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:19.619549 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f30e95f7-aa6f-41ce-b390-0c8bbb842205 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:19.619967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f30e95f7-aa6f-41ce-b390-0c8bbb842205 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:19.678972 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f30e95f7-aa6f-41ce-b390-0c8bbb842205 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:19.686839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f30e95f7-aa6f-41ce-b390-0c8bbb842205 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1217 microversion: 2.1 time: 0.080365 Aug 10 16:58:19.687396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 265/523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:19 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:19.734216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5c1177cc-c419-4a23-b4a7-8afcebabe4a9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:19.734800 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5c1177cc-c419-4a23-b4a7-8afcebabe4a9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:19.741163 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c1177cc-c419-4a23-b4a7-8afcebabe4a9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:19.741651 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c1177cc-c419-4a23-b4a7-8afcebabe4a9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:19.742086 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c1177cc-c419-4a23-b4a7-8afcebabe4a9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:19.742779 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c1177cc-c419-4a23-b4a7-8afcebabe4a9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:19.743231 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c1177cc-c419-4a23-b4a7-8afcebabe4a9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:19.743654 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c1177cc-c419-4a23-b4a7-8afcebabe4a9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:19.874847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5c1177cc-c419-4a23-b4a7-8afcebabe4a9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:19.882207 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5c1177cc-c419-4a23-b4a7-8afcebabe4a9 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.152436 Aug 10 16:58:19.882764 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 259/524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:19 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:19.973968 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4ca7333e-7377-4e93-a545-b50f662eea85 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:19.974575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4ca7333e-7377-4e93-a545-b50f662eea85 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:19.980386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ca7333e-7377-4e93-a545-b50f662eea85 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:19.980864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ca7333e-7377-4e93-a545-b50f662eea85 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:19.981289 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ca7333e-7377-4e93-a545-b50f662eea85 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:19.981999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ca7333e-7377-4e93-a545-b50f662eea85 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:19.982471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ca7333e-7377-4e93-a545-b50f662eea85 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:19.983554 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4ca7333e-7377-4e93-a545-b50f662eea85 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:20.112136 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4ca7333e-7377-4e93-a545-b50f662eea85 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:20.114330 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:20.120818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4ca7333e-7377-4e93-a545-b50f662eea85 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.150699 Aug 10 16:58:20.121446 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 266/525] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:19 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:20.707797 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5d5e7a78-3115-46cf-94f9-b909ffe26840 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:20.708694 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5d5e7a78-3115-46cf-94f9-b909ffe26840 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:20.714618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5e7a78-3115-46cf-94f9-b909ffe26840 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:20.715102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5e7a78-3115-46cf-94f9-b909ffe26840 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:20.715539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5e7a78-3115-46cf-94f9-b909ffe26840 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:20.716257 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5e7a78-3115-46cf-94f9-b909ffe26840 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:20.716717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5e7a78-3115-46cf-94f9-b909ffe26840 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:20.717146 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5e7a78-3115-46cf-94f9-b909ffe26840 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:20.734340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:20.777763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5d5e7a78-3115-46cf-94f9-b909ffe26840 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:20.785450 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5d5e7a78-3115-46cf-94f9-b909ffe26840 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1217 microversion: 2.1 time: 0.081480 Aug 10 16:58:20.786022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 260/526] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:20 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:20.902907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1b97057f-2042-40f5-8132-4e7701dbe316 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:20.903506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1b97057f-2042-40f5-8132-4e7701dbe316 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:20.909326 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b97057f-2042-40f5-8132-4e7701dbe316 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:20.909800 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b97057f-2042-40f5-8132-4e7701dbe316 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:20.910227 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b97057f-2042-40f5-8132-4e7701dbe316 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:20.910901 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b97057f-2042-40f5-8132-4e7701dbe316 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:20.911346 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b97057f-2042-40f5-8132-4e7701dbe316 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:20.911764 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b97057f-2042-40f5-8132-4e7701dbe316 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:21.036282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1b97057f-2042-40f5-8132-4e7701dbe316 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:21.043496 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1b97057f-2042-40f5-8132-4e7701dbe316 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.144631 Aug 10 16:58:21.044051 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 267/527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:20 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:21.141213 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-787688c5-0828-4a34-a6f6-1d65748df885 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:21.141853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-787688c5-0828-4a34-a6f6-1d65748df885 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:21.147743 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787688c5-0828-4a34-a6f6-1d65748df885 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:21.148262 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787688c5-0828-4a34-a6f6-1d65748df885 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:21.148703 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787688c5-0828-4a34-a6f6-1d65748df885 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:21.149395 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787688c5-0828-4a34-a6f6-1d65748df885 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:21.149850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787688c5-0828-4a34-a6f6-1d65748df885 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:21.150278 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787688c5-0828-4a34-a6f6-1d65748df885 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:21.277101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-787688c5-0828-4a34-a6f6-1d65748df885 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:21.284648 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-787688c5-0828-4a34-a6f6-1d65748df885 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.147226 Aug 10 16:58:21.285207 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 261/528] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:21 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:21.808007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6daf769d-23c1-40c5-9896-0abb9abf552d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:21.808644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6daf769d-23c1-40c5-9896-0abb9abf552d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:21.814512 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6daf769d-23c1-40c5-9896-0abb9abf552d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:21.814995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6daf769d-23c1-40c5-9896-0abb9abf552d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:21.815426 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6daf769d-23c1-40c5-9896-0abb9abf552d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:21.816110 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6daf769d-23c1-40c5-9896-0abb9abf552d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:21.816581 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6daf769d-23c1-40c5-9896-0abb9abf552d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:21.817000 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6daf769d-23c1-40c5-9896-0abb9abf552d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:21.875370 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6daf769d-23c1-40c5-9896-0abb9abf552d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:21.882658 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6daf769d-23c1-40c5-9896-0abb9abf552d tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1217 microversion: 2.1 time: 0.078459 Aug 10 16:58:21.883213 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 268/529] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:21 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:22.064688 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1fe5f52b-7c2e-4d07-b658-46d513cddb9c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:22.065254 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1fe5f52b-7c2e-4d07-b658-46d513cddb9c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:22.067492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:22.068305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=26 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:22.074079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe5f52b-7c2e-4d07-b658-46d513cddb9c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:22.074556 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe5f52b-7c2e-4d07-b658-46d513cddb9c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:22.074991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe5f52b-7c2e-4d07-b658-46d513cddb9c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:22.075674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe5f52b-7c2e-4d07-b658-46d513cddb9c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:22.076123 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe5f52b-7c2e-4d07-b658-46d513cddb9c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:22.077211 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe5f52b-7c2e-4d07-b658-46d513cddb9c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:22.133208 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 16:58:22.133696 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Wed Aug 10 16:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 16:58:22.206497 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1fe5f52b-7c2e-4d07-b658-46d513cddb9c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:22.213973 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1fe5f52b-7c2e-4d07-b658-46d513cddb9c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.153885 Aug 10 16:58:22.214532 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 262/530] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:22 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:22.305808 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-55815897-b816-4f01-9dc8-cd5d893c642f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:22.306693 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-55815897-b816-4f01-9dc8-cd5d893c642f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:22.313976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55815897-b816-4f01-9dc8-cd5d893c642f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:22.314466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55815897-b816-4f01-9dc8-cd5d893c642f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:22.314941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55815897-b816-4f01-9dc8-cd5d893c642f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:22.315586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55815897-b816-4f01-9dc8-cd5d893c642f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:22.316033 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55815897-b816-4f01-9dc8-cd5d893c642f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:22.316478 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55815897-b816-4f01-9dc8-cd5d893c642f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:22.449655 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-55815897-b816-4f01-9dc8-cd5d893c642f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:22.456958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-55815897-b816-4f01-9dc8-cd5d893c642f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.155253 Aug 10 16:58:22.457509 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 269/531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:22 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:22.903345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-65dcbca3-da21-421f-b7cb-40d58a186325 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:22.903953 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-65dcbca3-da21-421f-b7cb-40d58a186325 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:22.910449 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dcbca3-da21-421f-b7cb-40d58a186325 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:22.910930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dcbca3-da21-421f-b7cb-40d58a186325 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:22.911371 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dcbca3-da21-421f-b7cb-40d58a186325 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:22.912057 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dcbca3-da21-421f-b7cb-40d58a186325 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:22.912679 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dcbca3-da21-421f-b7cb-40d58a186325 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:22.913105 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dcbca3-da21-421f-b7cb-40d58a186325 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:22.971297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-65dcbca3-da21-421f-b7cb-40d58a186325 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:22.978537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-65dcbca3-da21-421f-b7cb-40d58a186325 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1217 microversion: 2.1 time: 0.079038 Aug 10 16:58:22.979096 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 263/532] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:22 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:23.233703 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3add9c5e-f1c7-4ae9-8228-170bacc3a9bf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:23.234614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3add9c5e-f1c7-4ae9-8228-170bacc3a9bf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:23.241360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3add9c5e-f1c7-4ae9-8228-170bacc3a9bf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:23.241844 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3add9c5e-f1c7-4ae9-8228-170bacc3a9bf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:23.242275 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3add9c5e-f1c7-4ae9-8228-170bacc3a9bf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:23.242956 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3add9c5e-f1c7-4ae9-8228-170bacc3a9bf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:23.243398 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3add9c5e-f1c7-4ae9-8228-170bacc3a9bf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:23.243813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3add9c5e-f1c7-4ae9-8228-170bacc3a9bf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:23.372725 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3add9c5e-f1c7-4ae9-8228-170bacc3a9bf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:23.380007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3add9c5e-f1c7-4ae9-8228-170bacc3a9bf tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.150226 Aug 10 16:58:23.380668 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 270/533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:23 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:23.496984 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7eed828c-e260-4606-a08b-64bd01138644 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:23.497529 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7eed828c-e260-4606-a08b-64bd01138644 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:23.504046 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eed828c-e260-4606-a08b-64bd01138644 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:23.504563 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eed828c-e260-4606-a08b-64bd01138644 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:23.505000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eed828c-e260-4606-a08b-64bd01138644 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:23.505689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eed828c-e260-4606-a08b-64bd01138644 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:23.506208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eed828c-e260-4606-a08b-64bd01138644 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:23.506667 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eed828c-e260-4606-a08b-64bd01138644 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:23.679932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7eed828c-e260-4606-a08b-64bd01138644 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:23.688994 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7eed828c-e260-4606-a08b-64bd01138644 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.195891 Aug 10 16:58:23.689856 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 264/534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:23 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:23.999632 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-47437b3c-949a-4ab7-8801-4ed870d6cc20 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:24.000253 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-47437b3c-949a-4ab7-8801-4ed870d6cc20 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:24.006060 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47437b3c-949a-4ab7-8801-4ed870d6cc20 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:24.006535 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47437b3c-949a-4ab7-8801-4ed870d6cc20 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:24.006961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47437b3c-949a-4ab7-8801-4ed870d6cc20 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:24.007644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47437b3c-949a-4ab7-8801-4ed870d6cc20 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:24.008087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47437b3c-949a-4ab7-8801-4ed870d6cc20 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:24.008525 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47437b3c-949a-4ab7-8801-4ed870d6cc20 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:24.074110 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-47437b3c-949a-4ab7-8801-4ed870d6cc20 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:24.081393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-47437b3c-949a-4ab7-8801-4ed870d6cc20 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1265 microversion: 2.1 time: 0.086161 Aug 10 16:58:24.081945 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 271/535] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:23 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:24.401931 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4c48518e-7908-4fcb-9e57-9a272e606647 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:24.402543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4c48518e-7908-4fcb-9e57-9a272e606647 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:24.408950 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c48518e-7908-4fcb-9e57-9a272e606647 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:24.409443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c48518e-7908-4fcb-9e57-9a272e606647 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:24.409884 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c48518e-7908-4fcb-9e57-9a272e606647 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:24.410581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c48518e-7908-4fcb-9e57-9a272e606647 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:24.411040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c48518e-7908-4fcb-9e57-9a272e606647 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:24.411466 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c48518e-7908-4fcb-9e57-9a272e606647 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:24.545144 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4c48518e-7908-4fcb-9e57-9a272e606647 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:24.553237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4c48518e-7908-4fcb-9e57-9a272e606647 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.155667 Aug 10 16:58:24.553817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 265/536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:24 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:24.710164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-60878a15-3338-4c78-b921-3ee250b53f0f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:24.710771 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-60878a15-3338-4c78-b921-3ee250b53f0f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:24.716764 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60878a15-3338-4c78-b921-3ee250b53f0f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:24.717245 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60878a15-3338-4c78-b921-3ee250b53f0f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:24.717674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60878a15-3338-4c78-b921-3ee250b53f0f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:24.719055 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60878a15-3338-4c78-b921-3ee250b53f0f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:24.719503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60878a15-3338-4c78-b921-3ee250b53f0f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:24.719924 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60878a15-3338-4c78-b921-3ee250b53f0f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:24.849591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-60878a15-3338-4c78-b921-3ee250b53f0f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:24.856898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-60878a15-3338-4c78-b921-3ee250b53f0f tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.150896 Aug 10 16:58:24.857453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 272/537] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:24 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:25.102367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1ae85690-23d6-4961-b845-a953416eb3d8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:25.102979 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1ae85690-23d6-4961-b845-a953416eb3d8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:25.109468 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae85690-23d6-4961-b845-a953416eb3d8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:25.109955 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae85690-23d6-4961-b845-a953416eb3d8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:25.110394 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae85690-23d6-4961-b845-a953416eb3d8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:25.111089 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae85690-23d6-4961-b845-a953416eb3d8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:25.111543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae85690-23d6-4961-b845-a953416eb3d8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:25.111971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae85690-23d6-4961-b845-a953416eb3d8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:25.174587 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1ae85690-23d6-4961-b845-a953416eb3d8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:25.181898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1ae85690-23d6-4961-b845-a953416eb3d8 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1271 microversion: 2.1 time: 0.083479 Aug 10 16:58:25.182466 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 266/538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:25 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:25.574008 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a2a4fc8c-4005-4642-a1d3-ee4d4e3bcb99 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:25.574615 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a2a4fc8c-4005-4642-a1d3-ee4d4e3bcb99 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:25.582503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2a4fc8c-4005-4642-a1d3-ee4d4e3bcb99 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:25.582981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2a4fc8c-4005-4642-a1d3-ee4d4e3bcb99 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:25.583674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2a4fc8c-4005-4642-a1d3-ee4d4e3bcb99 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:25.584392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2a4fc8c-4005-4642-a1d3-ee4d4e3bcb99 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:25.584845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2a4fc8c-4005-4642-a1d3-ee4d4e3bcb99 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:25.585650 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2a4fc8c-4005-4642-a1d3-ee4d4e3bcb99 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:25.715740 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a2a4fc8c-4005-4642-a1d3-ee4d4e3bcb99 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:25.723736 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a2a4fc8c-4005-4642-a1d3-ee4d4e3bcb99 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.153704 Aug 10 16:58:25.724332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 273/539] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:25 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:25.877777 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ad7b25b2-359b-4988-b6c6-01a76559b7e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:25.878426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ad7b25b2-359b-4988-b6c6-01a76559b7e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:25.885148 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b2-359b-4988-b6c6-01a76559b7e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:25.885636 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b2-359b-4988-b6c6-01a76559b7e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:25.886064 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b2-359b-4988-b6c6-01a76559b7e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:25.886761 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b2-359b-4988-b6c6-01a76559b7e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:25.887210 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b2-359b-4988-b6c6-01a76559b7e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:25.887629 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b2-359b-4988-b6c6-01a76559b7e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:26.014131 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ad7b25b2-359b-4988-b6c6-01a76559b7e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:26.022134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ad7b25b2-359b-4988-b6c6-01a76559b7e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.148667 Aug 10 16:58:26.022766 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 267/540] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:25 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:26.202782 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-da6887ce-e378-4e76-9711-ce6b7938014e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:26.203390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-da6887ce-e378-4e76-9711-ce6b7938014e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:26.209497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da6887ce-e378-4e76-9711-ce6b7938014e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:26.209980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da6887ce-e378-4e76-9711-ce6b7938014e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:26.210407 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da6887ce-e378-4e76-9711-ce6b7938014e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:26.211090 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da6887ce-e378-4e76-9711-ce6b7938014e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:26.211539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da6887ce-e378-4e76-9711-ce6b7938014e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:26.211960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da6887ce-e378-4e76-9711-ce6b7938014e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:26.274413 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-da6887ce-e378-4e76-9711-ce6b7938014e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:26.281905 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-da6887ce-e378-4e76-9711-ce6b7938014e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1271 microversion: 2.1 time: 0.082995 Aug 10 16:58:26.282469 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 274/541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:26 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:26.680331 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0368eb16-533a-486a-9696-a02b9d4c281b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:26.680821 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0368eb16-533a-486a-9696-a02b9d4c281b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:26.686606 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0368eb16-533a-486a-9696-a02b9d4c281b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:26.687084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0368eb16-533a-486a-9696-a02b9d4c281b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:26.687514 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0368eb16-533a-486a-9696-a02b9d4c281b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:26.688214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0368eb16-533a-486a-9696-a02b9d4c281b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:26.688665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0368eb16-533a-486a-9696-a02b9d4c281b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:26.689086 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0368eb16-533a-486a-9696-a02b9d4c281b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:26.744654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ca911d60-7004-4769-a1d8-f74b3056e683 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:26.745254 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ca911d60-7004-4769-a1d8-f74b3056e683 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:26.751017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca911d60-7004-4769-a1d8-f74b3056e683 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:26.751497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca911d60-7004-4769-a1d8-f74b3056e683 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:26.751976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca911d60-7004-4769-a1d8-f74b3056e683 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:26.752720 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca911d60-7004-4769-a1d8-f74b3056e683 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:26.753162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca911d60-7004-4769-a1d8-f74b3056e683 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:26.753576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca911d60-7004-4769-a1d8-f74b3056e683 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:26.813061 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-0368eb16-533a-486a-9696-a02b9d4c281b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lazy-loading 'services' on Instance uuid bae55935-f47f-403d-80dc-416589153662 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:58:26.885463 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ca911d60-7004-4769-a1d8-f74b3056e683 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:26.892887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ca911d60-7004-4769-a1d8-f74b3056e683 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.151973 Aug 10 16:58:26.893449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 275/542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:26 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:26.932474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0368eb16-533a-486a-9696-a02b9d4c281b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662/os-volume_attachments/6f2e420d-3ae1-46d5-8bf2-3f91e5a9746c" status: 202 len: 0 microversion: 2.1 time: 0.255847 Aug 10 16:58:26.935689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 268/543] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 16:58:26 2022] DELETE /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662/os-volume_attachments/6f2e420d-3ae1-46d5-8bf2-3f91e5a9746c => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 16:58:27.042752 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c803ea5b-69ef-4690-a86a-546fdbe1cf00 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:27.043362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c803ea5b-69ef-4690-a86a-546fdbe1cf00 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:27.049293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c803ea5b-69ef-4690-a86a-546fdbe1cf00 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:27.049786 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c803ea5b-69ef-4690-a86a-546fdbe1cf00 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:27.050203 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c803ea5b-69ef-4690-a86a-546fdbe1cf00 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:27.050881 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c803ea5b-69ef-4690-a86a-546fdbe1cf00 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:27.051331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c803ea5b-69ef-4690-a86a-546fdbe1cf00 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:27.051895 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c803ea5b-69ef-4690-a86a-546fdbe1cf00 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:27.180095 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c803ea5b-69ef-4690-a86a-546fdbe1cf00 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:27.187398 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c803ea5b-69ef-4690-a86a-546fdbe1cf00 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.148431 Aug 10 16:58:27.187941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 276/544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:27 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:27.303183 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8c1d13dd-c341-4fdb-8c0f-d798e9a53531 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:27.303868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8c1d13dd-c341-4fdb-8c0f-d798e9a53531 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:27.310445 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1d13dd-c341-4fdb-8c0f-d798e9a53531 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:27.310924 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1d13dd-c341-4fdb-8c0f-d798e9a53531 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:27.311355 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1d13dd-c341-4fdb-8c0f-d798e9a53531 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:27.312602 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1d13dd-c341-4fdb-8c0f-d798e9a53531 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:27.313053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1d13dd-c341-4fdb-8c0f-d798e9a53531 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:27.313473 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1d13dd-c341-4fdb-8c0f-d798e9a53531 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:27.372594 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8c1d13dd-c341-4fdb-8c0f-d798e9a53531 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:27.380242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8c1d13dd-c341-4fdb-8c0f-d798e9a53531 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1271 microversion: 2.1 time: 0.081265 Aug 10 16:58:27.380802 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 269/545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:27 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:27.913475 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8d21fed6-c7f6-4f18-8054-4da1f00e3a57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:27.914319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8d21fed6-c7f6-4f18-8054-4da1f00e3a57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:27.920165 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d21fed6-c7f6-4f18-8054-4da1f00e3a57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:27.920671 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d21fed6-c7f6-4f18-8054-4da1f00e3a57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:27.921109 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d21fed6-c7f6-4f18-8054-4da1f00e3a57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:27.921800 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d21fed6-c7f6-4f18-8054-4da1f00e3a57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:27.922249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d21fed6-c7f6-4f18-8054-4da1f00e3a57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:27.922761 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d21fed6-c7f6-4f18-8054-4da1f00e3a57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:28.115895 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8d21fed6-c7f6-4f18-8054-4da1f00e3a57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:28.123258 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8d21fed6-c7f6-4f18-8054-4da1f00e3a57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.213935 Aug 10 16:58:28.123820 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 277/546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:27 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:28.208661 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e51d42e5-e435-4499-a9b3-34def93a1d42 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:28.209277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e51d42e5-e435-4499-a9b3-34def93a1d42 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:28.226026 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e51d42e5-e435-4499-a9b3-34def93a1d42 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:28.226531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e51d42e5-e435-4499-a9b3-34def93a1d42 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:28.226974 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e51d42e5-e435-4499-a9b3-34def93a1d42 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:28.227898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e51d42e5-e435-4499-a9b3-34def93a1d42 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:28.228547 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e51d42e5-e435-4499-a9b3-34def93a1d42 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:28.228980 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e51d42e5-e435-4499-a9b3-34def93a1d42 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:28.401774 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e51d42e5-e435-4499-a9b3-34def93a1d42 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:28.403809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-110be5bd-2cc2-42e6-915c-65b66752979b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:28.404471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-110be5bd-2cc2-42e6-915c-65b66752979b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:28.411324 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-110be5bd-2cc2-42e6-915c-65b66752979b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:28.411558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e51d42e5-e435-4499-a9b3-34def93a1d42 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.206773 Aug 10 16:58:28.412229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-110be5bd-2cc2-42e6-915c-65b66752979b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:28.412899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-110be5bd-2cc2-42e6-915c-65b66752979b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:28.414307 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-110be5bd-2cc2-42e6-915c-65b66752979b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:28.415100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-110be5bd-2cc2-42e6-915c-65b66752979b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:28.415685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-110be5bd-2cc2-42e6-915c-65b66752979b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:28.425073 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 270/547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:28 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:28.572511 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-110be5bd-2cc2-42e6-915c-65b66752979b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:28.582321 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-110be5bd-2cc2-42e6-915c-65b66752979b tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.184369 Aug 10 16:58:28.583314 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 278/548] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:28 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:28.627860 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e27041ab-7fe7-4533-a843-0a8bd572bace req-6b96a16f-d823-4542-bd52-1e220187b3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c067dba5-55d9-421c-badd-f6829a136d59", "name": "network-vif-plugged", "status": "completed", "tag": "08bdac8b-67f5-4f63-882d-658131e050a5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:28.637341 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e27041ab-7fe7-4533-a843-0a8bd572bace req-6b96a16f-d823-4542-bd52-1e220187b3da service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:28.637832 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e27041ab-7fe7-4533-a843-0a8bd572bace req-6b96a16f-d823-4542-bd52-1e220187b3da service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:28.638515 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e27041ab-7fe7-4533-a843-0a8bd572bace req-6b96a16f-d823-4542-bd52-1e220187b3da service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:28.649791 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e27041ab-7fe7-4533-a843-0a8bd572bace req-6b96a16f-d823-4542-bd52-1e220187b3da service nova] Creating event network-vif-plugged:08bdac8b-67f5-4f63-882d-658131e050a5 for instance c067dba5-55d9-421c-badd-f6829a136d59 on hv-cinder-83602 Aug 10 16:58:28.654602 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e27041ab-7fe7-4533-a843-0a8bd572bace req-6b96a16f-d823-4542-bd52-1e220187b3da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030560 Aug 10 16:58:28.655826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 271/549] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:58:29.144663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-383e5877-66b6-466f-a99c-9db6ea513251 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:29.145261 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-383e5877-66b6-466f-a99c-9db6ea513251 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:29.151191 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-383e5877-66b6-466f-a99c-9db6ea513251 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:29.151875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-383e5877-66b6-466f-a99c-9db6ea513251 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:29.152344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-383e5877-66b6-466f-a99c-9db6ea513251 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:29.153023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-383e5877-66b6-466f-a99c-9db6ea513251 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:29.153473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-383e5877-66b6-466f-a99c-9db6ea513251 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:29.153888 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-383e5877-66b6-466f-a99c-9db6ea513251 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:29.401448 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-383e5877-66b6-466f-a99c-9db6ea513251 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:29.409790 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-383e5877-66b6-466f-a99c-9db6ea513251 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.268976 Aug 10 16:58:29.420575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 279/550] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:29 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:29.436034 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e89ea92d-ed2f-498c-97e7-53b5bd7f40e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:29.436903 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e89ea92d-ed2f-498c-97e7-53b5bd7f40e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:29.446595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e89ea92d-ed2f-498c-97e7-53b5bd7f40e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:29.451249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e89ea92d-ed2f-498c-97e7-53b5bd7f40e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:29.452525 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e89ea92d-ed2f-498c-97e7-53b5bd7f40e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:29.453491 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e89ea92d-ed2f-498c-97e7-53b5bd7f40e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:29.457040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e89ea92d-ed2f-498c-97e7-53b5bd7f40e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:29.457711 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e89ea92d-ed2f-498c-97e7-53b5bd7f40e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:29.605098 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-36a6c81a-4ec5-4b6f-a860-a19201255d6f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:29.605850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-36a6c81a-4ec5-4b6f-a860-a19201255d6f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:29.612897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36a6c81a-4ec5-4b6f-a860-a19201255d6f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:29.613757 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36a6c81a-4ec5-4b6f-a860-a19201255d6f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:29.614268 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36a6c81a-4ec5-4b6f-a860-a19201255d6f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:29.615183 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36a6c81a-4ec5-4b6f-a860-a19201255d6f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:29.615864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36a6c81a-4ec5-4b6f-a860-a19201255d6f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:29.616523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36a6c81a-4ec5-4b6f-a860-a19201255d6f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:29.641460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e89ea92d-ed2f-498c-97e7-53b5bd7f40e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:29.649435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e89ea92d-ed2f-498c-97e7-53b5bd7f40e6 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.219349 Aug 10 16:58:29.650021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 272/551] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:29 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:29.902268 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-36a6c81a-4ec5-4b6f-a860-a19201255d6f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:29.909855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-36a6c81a-4ec5-4b6f-a860-a19201255d6f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.309622 Aug 10 16:58:29.910424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 280/552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:29 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:29.978317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-da0799ea-693c-46eb-9bfe-7375a2354609 req-2cd82fa3-a674-4c64-98ba-2780eeb66282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8fd7777-3552-4a5f-b33a-cb1f0f356fd3", "tag": "9ab3c42c-77e3-4c02-b205-b6cc2e654956"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:29.988069 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-da0799ea-693c-46eb-9bfe-7375a2354609 req-2cd82fa3-a674-4c64-98ba-2780eeb66282 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:29.988580 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-da0799ea-693c-46eb-9bfe-7375a2354609 req-2cd82fa3-a674-4c64-98ba-2780eeb66282 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:29.989008 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-da0799ea-693c-46eb-9bfe-7375a2354609 req-2cd82fa3-a674-4c64-98ba-2780eeb66282 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:29.999988 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-da0799ea-693c-46eb-9bfe-7375a2354609 req-2cd82fa3-a674-4c64-98ba-2780eeb66282 service nova] Creating event network-changed:9ab3c42c-77e3-4c02-b205-b6cc2e654956 for instance a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 on hv-cinder-83602 Aug 10 16:58:30.004609 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-da0799ea-693c-46eb-9bfe-7375a2354609 req-2cd82fa3-a674-4c64-98ba-2780eeb66282 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029896 Aug 10 16:58:30.005243 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 273/553] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:58:30.197233 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-192bcd1f-15da-448e-bef6-7029d7d25ccc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:30.197707 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-192bcd1f-15da-448e-bef6-7029d7d25ccc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:30.203500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192bcd1f-15da-448e-bef6-7029d7d25ccc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:30.203978 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192bcd1f-15da-448e-bef6-7029d7d25ccc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:30.204469 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192bcd1f-15da-448e-bef6-7029d7d25ccc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:30.205147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192bcd1f-15da-448e-bef6-7029d7d25ccc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:30.205595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192bcd1f-15da-448e-bef6-7029d7d25ccc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:30.206013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-192bcd1f-15da-448e-bef6-7029d7d25ccc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:30.229784 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-192bcd1f-15da-448e-bef6-7029d7d25ccc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 16:58:30.277642 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:30.303366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-192bcd1f-15da-448e-bef6-7029d7d25ccc tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 204 len: 0 microversion: 2.1 time: 0.109681 Aug 10 16:58:30.303947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 281/554] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 16:58:30 2022] DELETE /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 16:58:30.313012 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95c2a7b8-c4a0-4c1a-9aa5-062a9fcbb6bf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:30.313844 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-95c2a7b8-c4a0-4c1a-9aa5-062a9fcbb6bf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:30.320090 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95c2a7b8-c4a0-4c1a-9aa5-062a9fcbb6bf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:30.320609 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95c2a7b8-c4a0-4c1a-9aa5-062a9fcbb6bf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:30.326761 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95c2a7b8-c4a0-4c1a-9aa5-062a9fcbb6bf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:30.327592 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95c2a7b8-c4a0-4c1a-9aa5-062a9fcbb6bf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:30.328306 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95c2a7b8-c4a0-4c1a-9aa5-062a9fcbb6bf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:30.328750 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95c2a7b8-c4a0-4c1a-9aa5-062a9fcbb6bf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:30.430680 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b85c9c05-5794-4fd8-a471-bcda41b3f2c2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:30.431468 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b85c9c05-5794-4fd8-a471-bcda41b3f2c2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:30.437875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b85c9c05-5794-4fd8-a471-bcda41b3f2c2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:30.438356 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b85c9c05-5794-4fd8-a471-bcda41b3f2c2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:30.438782 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b85c9c05-5794-4fd8-a471-bcda41b3f2c2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:30.439475 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b85c9c05-5794-4fd8-a471-bcda41b3f2c2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:30.439921 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b85c9c05-5794-4fd8-a471-bcda41b3f2c2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:30.440365 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b85c9c05-5794-4fd8-a471-bcda41b3f2c2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:30.461771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-95c2a7b8-c4a0-4c1a-9aa5-062a9fcbb6bf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:30.469851 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95c2a7b8-c4a0-4c1a-9aa5-062a9fcbb6bf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1511 microversion: 2.1 time: 0.161082 Aug 10 16:58:30.470548 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 274/555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:30 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:30.581347 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b85c9c05-5794-4fd8-a471-bcda41b3f2c2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:30.589501 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b85c9c05-5794-4fd8-a471-bcda41b3f2c2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.162938 Aug 10 16:58:30.590065 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 282/556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:30 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:30.670102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce7a0948-459f-4705-bb34-4c29ec0d75c3 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:30.671231 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ce7a0948-459f-4705-bb34-4c29ec0d75c3 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:30.677041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce7a0948-459f-4705-bb34-4c29ec0d75c3 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:30.677519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce7a0948-459f-4705-bb34-4c29ec0d75c3 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:30.677947 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce7a0948-459f-4705-bb34-4c29ec0d75c3 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:30.678625 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce7a0948-459f-4705-bb34-4c29ec0d75c3 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:30.679071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce7a0948-459f-4705-bb34-4c29ec0d75c3 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:30.679489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce7a0948-459f-4705-bb34-4c29ec0d75c3 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:30.807395 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce7a0948-459f-4705-bb34-4c29ec0d75c3 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:30.815700 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce7a0948-459f-4705-bb34-4c29ec0d75c3 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.149341 Aug 10 16:58:30.816309 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 275/557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:30 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:30.930675 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5c7705f8-4910-475b-9ccd-aecee29c0b3c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:30.931289 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5c7705f8-4910-475b-9ccd-aecee29c0b3c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:30.937736 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c7705f8-4910-475b-9ccd-aecee29c0b3c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:30.938216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c7705f8-4910-475b-9ccd-aecee29c0b3c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:30.938652 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c7705f8-4910-475b-9ccd-aecee29c0b3c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:30.939340 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c7705f8-4910-475b-9ccd-aecee29c0b3c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:30.939793 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c7705f8-4910-475b-9ccd-aecee29c0b3c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:30.940246 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c7705f8-4910-475b-9ccd-aecee29c0b3c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:31.065672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5c7705f8-4910-475b-9ccd-aecee29c0b3c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:31.073033 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5c7705f8-4910-475b-9ccd-aecee29c0b3c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.146169 Aug 10 16:58:31.073595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 283/558] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:30 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:31.490339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-903c25da-9a5e-425b-98e7-9e090fcf9699 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:31.491599 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-903c25da-9a5e-425b-98e7-9e090fcf9699 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:31.498497 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-903c25da-9a5e-425b-98e7-9e090fcf9699 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:31.499007 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-903c25da-9a5e-425b-98e7-9e090fcf9699 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:31.499444 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-903c25da-9a5e-425b-98e7-9e090fcf9699 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:31.500159 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-903c25da-9a5e-425b-98e7-9e090fcf9699 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:31.500644 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-903c25da-9a5e-425b-98e7-9e090fcf9699 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:31.501075 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-903c25da-9a5e-425b-98e7-9e090fcf9699 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:31.613398 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-55db5ea1-46ba-49d4-a24c-c0967ef93a25 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:31.614097 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-55db5ea1-46ba-49d4-a24c-c0967ef93a25 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:31.620196 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55db5ea1-46ba-49d4-a24c-c0967ef93a25 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:31.620689 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55db5ea1-46ba-49d4-a24c-c0967ef93a25 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:31.621159 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55db5ea1-46ba-49d4-a24c-c0967ef93a25 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:31.621864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55db5ea1-46ba-49d4-a24c-c0967ef93a25 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:31.622323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55db5ea1-46ba-49d4-a24c-c0967ef93a25 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:31.622749 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55db5ea1-46ba-49d4-a24c-c0967ef93a25 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:31.628457 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-903c25da-9a5e-425b-98e7-9e090fcf9699 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:31.636051 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-903c25da-9a5e-425b-98e7-9e090fcf9699 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1511 microversion: 2.1 time: 0.149535 Aug 10 16:58:31.636672 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 276/559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:31 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:31.756414 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-55db5ea1-46ba-49d4-a24c-c0967ef93a25 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:31.763871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-55db5ea1-46ba-49d4-a24c-c0967ef93a25 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.154320 Aug 10 16:58:31.764960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 284/560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:31 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:31.836131 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e00c4cb3-3080-426d-a341-b4231ab5f289 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:31.836763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e00c4cb3-3080-426d-a341-b4231ab5f289 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:31.842604 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00c4cb3-3080-426d-a341-b4231ab5f289 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:31.843083 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00c4cb3-3080-426d-a341-b4231ab5f289 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:31.843517 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00c4cb3-3080-426d-a341-b4231ab5f289 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:31.844230 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00c4cb3-3080-426d-a341-b4231ab5f289 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:31.844685 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00c4cb3-3080-426d-a341-b4231ab5f289 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:31.845108 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00c4cb3-3080-426d-a341-b4231ab5f289 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:31.973840 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e00c4cb3-3080-426d-a341-b4231ab5f289 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:31.977345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:31.982174 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e00c4cb3-3080-426d-a341-b4231ab5f289 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1314 microversion: 2.1 time: 0.150118 Aug 10 16:58:31.982731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 277/561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:31 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:32.093752 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-49a5315a-65ad-4b09-bcc1-bc5779ad59d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:32.094354 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-49a5315a-65ad-4b09-bcc1-bc5779ad59d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:32.100170 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49a5315a-65ad-4b09-bcc1-bc5779ad59d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:32.100662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49a5315a-65ad-4b09-bcc1-bc5779ad59d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:32.101090 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49a5315a-65ad-4b09-bcc1-bc5779ad59d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:32.101771 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49a5315a-65ad-4b09-bcc1-bc5779ad59d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:32.102218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49a5315a-65ad-4b09-bcc1-bc5779ad59d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:32.102638 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-49a5315a-65ad-4b09-bcc1-bc5779ad59d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:32.227596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-49a5315a-65ad-4b09-bcc1-bc5779ad59d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:32.235002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-49a5315a-65ad-4b09-bcc1-bc5779ad59d7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.145619 Aug 10 16:58:32.235563 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 285/562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:32 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:32.657489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29f81b0b-0f4d-48a2-8ccf-31e9464bfd4a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:32.658052 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-29f81b0b-0f4d-48a2-8ccf-31e9464bfd4a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:32.665474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29f81b0b-0f4d-48a2-8ccf-31e9464bfd4a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:32.665960 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29f81b0b-0f4d-48a2-8ccf-31e9464bfd4a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:32.666397 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29f81b0b-0f4d-48a2-8ccf-31e9464bfd4a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:32.667092 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29f81b0b-0f4d-48a2-8ccf-31e9464bfd4a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:32.667544 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29f81b0b-0f4d-48a2-8ccf-31e9464bfd4a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:32.667970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29f81b0b-0f4d-48a2-8ccf-31e9464bfd4a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:32.785044 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0bc2a714-0e70-4164-8fa2-be428d72060a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:32.786312 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0bc2a714-0e70-4164-8fa2-be428d72060a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:32.792304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bc2a714-0e70-4164-8fa2-be428d72060a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:32.793045 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bc2a714-0e70-4164-8fa2-be428d72060a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:32.793435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bc2a714-0e70-4164-8fa2-be428d72060a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:32.794158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bc2a714-0e70-4164-8fa2-be428d72060a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:32.794609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bc2a714-0e70-4164-8fa2-be428d72060a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:32.795147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bc2a714-0e70-4164-8fa2-be428d72060a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:32.801218 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-29f81b0b-0f4d-48a2-8ccf-31e9464bfd4a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:32.809073 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29f81b0b-0f4d-48a2-8ccf-31e9464bfd4a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1511 microversion: 2.1 time: 0.155371 Aug 10 16:58:32.809730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 278/563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:32 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:32.849662 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-358c48d0-775e-4974-9c89-e3424c6603b3 req-deb01dc8-a305-412c-9ec3-22a19261a9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e3c08d-8649-4c99-8c7c-a57166ebc96b", "name": "network-vif-plugged", "status": "completed", "tag": "6d51b077-087c-428f-af01-0240852d1af2"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:32.859866 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-358c48d0-775e-4974-9c89-e3424c6603b3 req-deb01dc8-a305-412c-9ec3-22a19261a9cb service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:32.860642 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-358c48d0-775e-4974-9c89-e3424c6603b3 req-deb01dc8-a305-412c-9ec3-22a19261a9cb service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:32.861459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-358c48d0-775e-4974-9c89-e3424c6603b3 req-deb01dc8-a305-412c-9ec3-22a19261a9cb service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:32.872905 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-358c48d0-775e-4974-9c89-e3424c6603b3 req-deb01dc8-a305-412c-9ec3-22a19261a9cb service nova] Creating event network-vif-plugged:6d51b077-087c-428f-af01-0240852d1af2 for instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b on hv-cinder-83602 Aug 10 16:58:32.878459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-358c48d0-775e-4974-9c89-e3424c6603b3 req-deb01dc8-a305-412c-9ec3-22a19261a9cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032861 Aug 10 16:58:32.879236 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 279/564] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:58:32.992193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0bc2a714-0e70-4164-8fa2-be428d72060a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:33.000069 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0bc2a714-0e70-4164-8fa2-be428d72060a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.218787 Aug 10 16:58:33.000679 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 286/565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:32 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:33.004106 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b28c6fd7-33b3-4ab0-91af-f8c6a9752e15 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:33.005050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b28c6fd7-33b3-4ab0-91af-f8c6a9752e15 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:33.011246 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b28c6fd7-33b3-4ab0-91af-f8c6a9752e15 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:33.011853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b28c6fd7-33b3-4ab0-91af-f8c6a9752e15 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:33.012523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b28c6fd7-33b3-4ab0-91af-f8c6a9752e15 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:33.013344 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b28c6fd7-33b3-4ab0-91af-f8c6a9752e15 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:33.014094 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b28c6fd7-33b3-4ab0-91af-f8c6a9752e15 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:33.015145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b28c6fd7-33b3-4ab0-91af-f8c6a9752e15 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:33.152479 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b28c6fd7-33b3-4ab0-91af-f8c6a9752e15 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:33.160515 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b28c6fd7-33b3-4ab0-91af-f8c6a9752e15 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1463 microversion: 2.1 time: 0.161119 Aug 10 16:58:33.161076 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 280/566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:32 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:33.204487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a9949b77-1970-4e3b-91ab-3ee084032e64 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:33.204976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a9949b77-1970-4e3b-91ab-3ee084032e64 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:33.210991 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9949b77-1970-4e3b-91ab-3ee084032e64 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:33.211463 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9949b77-1970-4e3b-91ab-3ee084032e64 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:33.211887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9949b77-1970-4e3b-91ab-3ee084032e64 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:33.212586 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9949b77-1970-4e3b-91ab-3ee084032e64 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:33.213029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9949b77-1970-4e3b-91ab-3ee084032e64 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:33.213439 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9949b77-1970-4e3b-91ab-3ee084032e64 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:33.237531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a9949b77-1970-4e3b-91ab-3ee084032e64 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 16:58:33.254878 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9d3f1872-ec43-442e-8a85-a34dabc360a0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:33.255551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9d3f1872-ec43-442e-8a85-a34dabc360a0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:33.260183 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:33.266444 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d3f1872-ec43-442e-8a85-a34dabc360a0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:33.266935 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d3f1872-ec43-442e-8a85-a34dabc360a0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:33.267370 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d3f1872-ec43-442e-8a85-a34dabc360a0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:33.268069 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d3f1872-ec43-442e-8a85-a34dabc360a0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:33.268557 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d3f1872-ec43-442e-8a85-a34dabc360a0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:33.268978 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d3f1872-ec43-442e-8a85-a34dabc360a0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:33.317542 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a9949b77-1970-4e3b-91ab-3ee084032e64 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 204 len: 0 microversion: 2.1 time: 0.117293 Aug 10 16:58:33.318121 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 287/567] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 16:58:33 2022] DELETE /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 16:58:33.326374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7e5d3664-625d-4047-9550-e399a28b1bf5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:33.327677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7e5d3664-625d-4047-9550-e399a28b1bf5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:33.333665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5d3664-625d-4047-9550-e399a28b1bf5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:33.334132 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5d3664-625d-4047-9550-e399a28b1bf5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:33.334555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5d3664-625d-4047-9550-e399a28b1bf5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:33.335227 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5d3664-625d-4047-9550-e399a28b1bf5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:33.335668 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5d3664-625d-4047-9550-e399a28b1bf5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:33.336083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5d3664-625d-4047-9550-e399a28b1bf5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:33.405745 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9d3f1872-ec43-442e-8a85-a34dabc360a0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:33.414407 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9d3f1872-ec43-442e-8a85-a34dabc360a0 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.162828 Aug 10 16:58:33.414749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 281/568] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:33 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:33.470921 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7e5d3664-625d-4047-9550-e399a28b1bf5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:33.478485 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7e5d3664-625d-4047-9550-e399a28b1bf5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1469 microversion: 2.1 time: 0.156104 Aug 10 16:58:33.479042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 288/569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:33 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:33.831031 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2334fa81-3648-4a46-8ab7-8697c1b54921 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:33.831668 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2334fa81-3648-4a46-8ab7-8697c1b54921 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:33.838267 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2334fa81-3648-4a46-8ab7-8697c1b54921 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:33.838747 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2334fa81-3648-4a46-8ab7-8697c1b54921 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:33.839182 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2334fa81-3648-4a46-8ab7-8697c1b54921 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:33.839861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2334fa81-3648-4a46-8ab7-8697c1b54921 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:33.840340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2334fa81-3648-4a46-8ab7-8697c1b54921 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:33.840759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2334fa81-3648-4a46-8ab7-8697c1b54921 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:33.971223 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2334fa81-3648-4a46-8ab7-8697c1b54921 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:33.978588 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2334fa81-3648-4a46-8ab7-8697c1b54921 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1511 microversion: 2.1 time: 0.151385 Aug 10 16:58:33.979134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 282/570] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:33 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:34.021786 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2cd33b1a-536f-4280-a1dd-714bdcccb526 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:34.022396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2cd33b1a-536f-4280-a1dd-714bdcccb526 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:34.028201 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd33b1a-536f-4280-a1dd-714bdcccb526 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:34.028683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd33b1a-536f-4280-a1dd-714bdcccb526 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:34.029111 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd33b1a-536f-4280-a1dd-714bdcccb526 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:34.029797 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd33b1a-536f-4280-a1dd-714bdcccb526 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:34.030763 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd33b1a-536f-4280-a1dd-714bdcccb526 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:34.031180 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd33b1a-536f-4280-a1dd-714bdcccb526 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:34.160118 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2cd33b1a-536f-4280-a1dd-714bdcccb526 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:34.167424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2cd33b1a-536f-4280-a1dd-714bdcccb526 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.149427 Aug 10 16:58:34.167981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 289/571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:34 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:34.434581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3190a921-78b9-4546-82a1-9664ae937d59 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:34.435189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3190a921-78b9-4546-82a1-9664ae937d59 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:34.441316 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3190a921-78b9-4546-82a1-9664ae937d59 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:34.441801 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3190a921-78b9-4546-82a1-9664ae937d59 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:34.442241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3190a921-78b9-4546-82a1-9664ae937d59 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:34.442941 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3190a921-78b9-4546-82a1-9664ae937d59 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:34.443393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3190a921-78b9-4546-82a1-9664ae937d59 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:34.443815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3190a921-78b9-4546-82a1-9664ae937d59 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:34.498924 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-58c70625-6009-4a86-8d8d-d8bbd19051a0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:34.499536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-58c70625-6009-4a86-8d8d-d8bbd19051a0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:34.505465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58c70625-6009-4a86-8d8d-d8bbd19051a0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:34.505947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58c70625-6009-4a86-8d8d-d8bbd19051a0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:34.506382 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58c70625-6009-4a86-8d8d-d8bbd19051a0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:34.507068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58c70625-6009-4a86-8d8d-d8bbd19051a0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:34.507541 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58c70625-6009-4a86-8d8d-d8bbd19051a0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:34.507959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58c70625-6009-4a86-8d8d-d8bbd19051a0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:34.574327 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-3190a921-78b9-4546-82a1-9664ae937d59 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:34.582645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3190a921-78b9-4546-82a1-9664ae937d59 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.151899 Aug 10 16:58:34.583486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 283/572] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:34 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:34.641423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-58c70625-6009-4a86-8d8d-d8bbd19051a0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:34.648911 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-58c70625-6009-4a86-8d8d-d8bbd19051a0 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1469 microversion: 2.1 time: 0.154003 Aug 10 16:58:34.649484 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 290/573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:34 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:34.999519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5f32498-0ff0-4cc6-b524-b9aa12ef6eb1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:35.000128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a5f32498-0ff0-4cc6-b524-b9aa12ef6eb1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:35.006497 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f32498-0ff0-4cc6-b524-b9aa12ef6eb1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:35.006985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f32498-0ff0-4cc6-b524-b9aa12ef6eb1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:35.007423 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f32498-0ff0-4cc6-b524-b9aa12ef6eb1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:35.008114 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f32498-0ff0-4cc6-b524-b9aa12ef6eb1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:35.008595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f32498-0ff0-4cc6-b524-b9aa12ef6eb1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:35.009021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f32498-0ff0-4cc6-b524-b9aa12ef6eb1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:35.134639 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5f32498-0ff0-4cc6-b524-b9aa12ef6eb1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:35.142024 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5f32498-0ff0-4cc6-b524-b9aa12ef6eb1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1511 microversion: 2.1 time: 0.146313 Aug 10 16:58:35.142586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 284/574] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:34 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:35.187671 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-12ff2654-ca9a-4c05-9b67-4c53e6bd415c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:35.188301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-12ff2654-ca9a-4c05-9b67-4c53e6bd415c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:35.194156 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-12ff2654-ca9a-4c05-9b67-4c53e6bd415c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:35.194631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-12ff2654-ca9a-4c05-9b67-4c53e6bd415c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:35.195064 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-12ff2654-ca9a-4c05-9b67-4c53e6bd415c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:35.195738 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-12ff2654-ca9a-4c05-9b67-4c53e6bd415c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:35.196207 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-12ff2654-ca9a-4c05-9b67-4c53e6bd415c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:35.196628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-12ff2654-ca9a-4c05-9b67-4c53e6bd415c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:35.319717 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-12ff2654-ca9a-4c05-9b67-4c53e6bd415c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:35.327780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-12ff2654-ca9a-4c05-9b67-4c53e6bd415c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.143970 Aug 10 16:58:35.328363 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 291/575] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:35 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:35.604351 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d2b4e55c-e884-41b6-bcb2-59b5269dde7f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:35.605114 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d2b4e55c-e884-41b6-bcb2-59b5269dde7f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:35.611259 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b4e55c-e884-41b6-bcb2-59b5269dde7f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:35.611855 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b4e55c-e884-41b6-bcb2-59b5269dde7f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:35.612430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b4e55c-e884-41b6-bcb2-59b5269dde7f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:35.613882 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b4e55c-e884-41b6-bcb2-59b5269dde7f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:35.614738 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b4e55c-e884-41b6-bcb2-59b5269dde7f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:35.614947 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b4e55c-e884-41b6-bcb2-59b5269dde7f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:35.670832 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-125888de-3bbc-4730-9761-3d11b8a6fabc tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:35.671536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-125888de-3bbc-4730-9761-3d11b8a6fabc tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:35.677611 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-125888de-3bbc-4730-9761-3d11b8a6fabc tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:35.678232 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-125888de-3bbc-4730-9761-3d11b8a6fabc tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:35.679054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-125888de-3bbc-4730-9761-3d11b8a6fabc tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:35.679525 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-125888de-3bbc-4730-9761-3d11b8a6fabc tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:35.680043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-125888de-3bbc-4730-9761-3d11b8a6fabc tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:35.680568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-125888de-3bbc-4730-9761-3d11b8a6fabc tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:35.759317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d2b4e55c-e884-41b6-bcb2-59b5269dde7f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:35.767618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d2b4e55c-e884-41b6-bcb2-59b5269dde7f tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.167188 Aug 10 16:58:35.775312 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 285/576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:35 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:35.890008 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-125888de-3bbc-4730-9761-3d11b8a6fabc tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:35.897665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-125888de-3bbc-4730-9761-3d11b8a6fabc tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1469 microversion: 2.1 time: 0.230652 Aug 10 16:58:35.898241 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 292/577] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:35 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1469 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:36.102771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-05b36ae9-cb39-4dea-980d-000b6be1571b req-1e56d3ca-dd10-4a43-9b28-c734acf2083c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae55935-f47f-403d-80dc-416589153662", "name": "network-vif-deleted", "tag": "8cf30755-5eee-45c2-9369-24125c482072"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:36.113103 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-05b36ae9-cb39-4dea-980d-000b6be1571b req-1e56d3ca-dd10-4a43-9b28-c734acf2083c service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:36.113583 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-05b36ae9-cb39-4dea-980d-000b6be1571b req-1e56d3ca-dd10-4a43-9b28-c734acf2083c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:36.114016 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-05b36ae9-cb39-4dea-980d-000b6be1571b req-1e56d3ca-dd10-4a43-9b28-c734acf2083c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:36.125427 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-05b36ae9-cb39-4dea-980d-000b6be1571b req-1e56d3ca-dd10-4a43-9b28-c734acf2083c service nova] Creating event network-vif-deleted:8cf30755-5eee-45c2-9369-24125c482072 for instance bae55935-f47f-403d-80dc-416589153662 on hv-cinder-83602 Aug 10 16:58:36.130829 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-05b36ae9-cb39-4dea-980d-000b6be1571b req-1e56d3ca-dd10-4a43-9b28-c734acf2083c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031769 Aug 10 16:58:36.131400 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 286/578] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:58:36.162877 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1af17fd7-677b-4db5-8983-1ab0b3df6728 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:36.163497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1af17fd7-677b-4db5-8983-1ab0b3df6728 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:36.169464 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1af17fd7-677b-4db5-8983-1ab0b3df6728 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:36.169989 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1af17fd7-677b-4db5-8983-1ab0b3df6728 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:36.170420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1af17fd7-677b-4db5-8983-1ab0b3df6728 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:36.171579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1af17fd7-677b-4db5-8983-1ab0b3df6728 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:36.172022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1af17fd7-677b-4db5-8983-1ab0b3df6728 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:36.172461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1af17fd7-677b-4db5-8983-1ab0b3df6728 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:36.235049 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1af17fd7-677b-4db5-8983-1ab0b3df6728 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:36.242388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1af17fd7-677b-4db5-8983-1ab0b3df6728 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1469 microversion: 2.1 time: 0.083447 Aug 10 16:58:36.242945 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 293/579] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:36 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1469 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:36.349440 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-52ac87a7-1578-4efa-9580-371997ecf23f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:36.350131 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-52ac87a7-1578-4efa-9580-371997ecf23f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:36.356621 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52ac87a7-1578-4efa-9580-371997ecf23f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:36.357049 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52ac87a7-1578-4efa-9580-371997ecf23f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:36.357485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52ac87a7-1578-4efa-9580-371997ecf23f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:36.359043 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52ac87a7-1578-4efa-9580-371997ecf23f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:36.359507 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52ac87a7-1578-4efa-9580-371997ecf23f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:36.359932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52ac87a7-1578-4efa-9580-371997ecf23f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:36.492029 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-52ac87a7-1578-4efa-9580-371997ecf23f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:36.499430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-52ac87a7-1578-4efa-9580-371997ecf23f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.154129 Aug 10 16:58:36.500212 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 287/580] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:36 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:36.793131 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fd960bff-6b1e-4142-81ad-5e22ba62a837 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:36.793679 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fd960bff-6b1e-4142-81ad-5e22ba62a837 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:36.799517 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd960bff-6b1e-4142-81ad-5e22ba62a837 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:36.800001 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd960bff-6b1e-4142-81ad-5e22ba62a837 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:36.800457 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd960bff-6b1e-4142-81ad-5e22ba62a837 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:36.801143 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd960bff-6b1e-4142-81ad-5e22ba62a837 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:36.801591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd960bff-6b1e-4142-81ad-5e22ba62a837 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:36.802005 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd960bff-6b1e-4142-81ad-5e22ba62a837 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:36.897285 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-99b2a7e6-bac3-4e39-a5ff-8154c481f273 req-561d80f6-cfb0-455f-82ad-47e742e7c207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c067dba5-55d9-421c-badd-f6829a136d59", "name": "network-vif-unplugged", "status": "completed", "tag": "08bdac8b-67f5-4f63-882d-658131e050a5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:36.908792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-99b2a7e6-bac3-4e39-a5ff-8154c481f273 req-561d80f6-cfb0-455f-82ad-47e742e7c207 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:36.909351 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-99b2a7e6-bac3-4e39-a5ff-8154c481f273 req-561d80f6-cfb0-455f-82ad-47e742e7c207 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:36.909890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-99b2a7e6-bac3-4e39-a5ff-8154c481f273 req-561d80f6-cfb0-455f-82ad-47e742e7c207 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:36.921571 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-99b2a7e6-bac3-4e39-a5ff-8154c481f273 req-561d80f6-cfb0-455f-82ad-47e742e7c207 service nova] Creating event network-vif-unplugged:08bdac8b-67f5-4f63-882d-658131e050a5 for instance c067dba5-55d9-421c-badd-f6829a136d59 on hv-cinder-83602 Aug 10 16:58:36.926727 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-99b2a7e6-bac3-4e39-a5ff-8154c481f273 req-561d80f6-cfb0-455f-82ad-47e742e7c207 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033110 Aug 10 16:58:36.927681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 288/581] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:58:36.932917 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-819d9b89-6a63-4248-a577-13e57db8085b tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:36.933885 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-819d9b89-6a63-4248-a577-13e57db8085b tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:36.937596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fd960bff-6b1e-4142-81ad-5e22ba62a837 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:36.942956 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819d9b89-6a63-4248-a577-13e57db8085b tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:36.943678 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819d9b89-6a63-4248-a577-13e57db8085b tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:36.944372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819d9b89-6a63-4248-a577-13e57db8085b tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:36.945328 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819d9b89-6a63-4248-a577-13e57db8085b tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:36.945924 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819d9b89-6a63-4248-a577-13e57db8085b tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:36.946068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fd960bff-6b1e-4142-81ad-5e22ba62a837 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.156806 Aug 10 16:58:36.946813 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819d9b89-6a63-4248-a577-13e57db8085b tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:36.946946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 294/582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:36 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:37.080392 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-819d9b89-6a63-4248-a577-13e57db8085b tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:37.088033 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-819d9b89-6a63-4248-a577-13e57db8085b tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1469 microversion: 2.1 time: 0.159011 Aug 10 16:58:37.088629 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 289/583] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:36 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:37.262456 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1b82b779-dd35-496a-8caf-73249bdb71d7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:37.263055 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1b82b779-dd35-496a-8caf-73249bdb71d7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:37.269651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b82b779-dd35-496a-8caf-73249bdb71d7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:37.270135 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b82b779-dd35-496a-8caf-73249bdb71d7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:37.270559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b82b779-dd35-496a-8caf-73249bdb71d7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:37.271242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b82b779-dd35-496a-8caf-73249bdb71d7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:37.271677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b82b779-dd35-496a-8caf-73249bdb71d7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:37.272100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b82b779-dd35-496a-8caf-73249bdb71d7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:37.345652 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1b82b779-dd35-496a-8caf-73249bdb71d7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:37.354607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1b82b779-dd35-496a-8caf-73249bdb71d7 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1303 microversion: 2.1 time: 0.095885 Aug 10 16:58:37.355973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 295/584] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:37 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:37.521479 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8fb556ff-9fd6-4f02-a1f3-83250945b9da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:37.522198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8fb556ff-9fd6-4f02-a1f3-83250945b9da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:37.529099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb556ff-9fd6-4f02-a1f3-83250945b9da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:37.529686 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb556ff-9fd6-4f02-a1f3-83250945b9da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:37.530382 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb556ff-9fd6-4f02-a1f3-83250945b9da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:37.531159 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb556ff-9fd6-4f02-a1f3-83250945b9da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:37.531743 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb556ff-9fd6-4f02-a1f3-83250945b9da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:37.532496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb556ff-9fd6-4f02-a1f3-83250945b9da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:37.663540 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8fb556ff-9fd6-4f02-a1f3-83250945b9da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:37.671601 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8fb556ff-9fd6-4f02-a1f3-83250945b9da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1371 microversion: 2.1 time: 0.155195 Aug 10 16:58:37.672290 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 290/585] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:37 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:37.968535 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ff8cdef1-37a5-4e16-82fe-1a8b0aac9e74 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:37.969520 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ff8cdef1-37a5-4e16-82fe-1a8b0aac9e74 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:37.975995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff8cdef1-37a5-4e16-82fe-1a8b0aac9e74 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:37.976519 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff8cdef1-37a5-4e16-82fe-1a8b0aac9e74 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:37.976952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff8cdef1-37a5-4e16-82fe-1a8b0aac9e74 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:37.977640 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff8cdef1-37a5-4e16-82fe-1a8b0aac9e74 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:37.978088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff8cdef1-37a5-4e16-82fe-1a8b0aac9e74 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:37.978507 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff8cdef1-37a5-4e16-82fe-1a8b0aac9e74 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:38.108496 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ff8cdef1-37a5-4e16-82fe-1a8b0aac9e74 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:38.109470 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a00c454d-1f6e-452e-b734-3f26aa2c9045 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:38.110101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a00c454d-1f6e-452e-b734-3f26aa2c9045 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:38.110743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:38.116211 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a00c454d-1f6e-452e-b734-3f26aa2c9045 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:38.116774 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a00c454d-1f6e-452e-b734-3f26aa2c9045 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:38.117205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a00c454d-1f6e-452e-b734-3f26aa2c9045 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:38.117841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ff8cdef1-37a5-4e16-82fe-1a8b0aac9e74 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.154465 Aug 10 16:58:38.117975 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a00c454d-1f6e-452e-b734-3f26aa2c9045 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:38.118353 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a00c454d-1f6e-452e-b734-3f26aa2c9045 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:38.118471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 296/586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:37 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:38.118847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a00c454d-1f6e-452e-b734-3f26aa2c9045 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:38.145034 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-a42003cd-f963-4895-9ef0-7abdc3548c88 req-9217ebce-d033-4e93-90ba-2607a0ed6c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c067dba5-55d9-421c-badd-f6829a136d59", "name": "network-vif-deleted", "tag": "08bdac8b-67f5-4f63-882d-658131e050a5"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:38.154700 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-a42003cd-f963-4895-9ef0-7abdc3548c88 req-9217ebce-d033-4e93-90ba-2607a0ed6c04 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:38.155280 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-a42003cd-f963-4895-9ef0-7abdc3548c88 req-9217ebce-d033-4e93-90ba-2607a0ed6c04 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:38.155780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-a42003cd-f963-4895-9ef0-7abdc3548c88 req-9217ebce-d033-4e93-90ba-2607a0ed6c04 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:38.167181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-a42003cd-f963-4895-9ef0-7abdc3548c88 req-9217ebce-d033-4e93-90ba-2607a0ed6c04 service nova] Creating event network-vif-deleted:08bdac8b-67f5-4f63-882d-658131e050a5 for instance c067dba5-55d9-421c-badd-f6829a136d59 on hv-cinder-83602 Aug 10 16:58:38.172660 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-a42003cd-f963-4895-9ef0-7abdc3548c88 req-9217ebce-d033-4e93-90ba-2607a0ed6c04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031628 Aug 10 16:58:38.173244 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 297/587] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:58:38.179967 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a00c454d-1f6e-452e-b734-3f26aa2c9045 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:38.188001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a00c454d-1f6e-452e-b734-3f26aa2c9045 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1299 microversion: 2.1 time: 0.082501 Aug 10 16:58:38.188589 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 291/588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:38 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:38.376810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:38.377437 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:38.379317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:38.384714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:38.385194 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:38.385626 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:38.386310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:38.386761 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:38.387186 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:38.417824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:38.418353 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:38.418892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:38.419187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lazy-loading 'fault' on Instance uuid bae55935-f47f-403d-80dc-416589153662 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:58:38.461278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:38.468666 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e1415df6-0c44-4021-b7aa-a1a4beced1c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1308 microversion: 2.1 time: 0.096691 Aug 10 16:58:38.469231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 298/589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:38 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:38.696904 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-65dba749-121c-410a-b8b5-380423d67ec0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:38.697514 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-65dba749-121c-410a-b8b5-380423d67ec0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:38.704091 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dba749-121c-410a-b8b5-380423d67ec0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:38.704605 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dba749-121c-410a-b8b5-380423d67ec0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:38.705041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dba749-121c-410a-b8b5-380423d67ec0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:38.705731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dba749-121c-410a-b8b5-380423d67ec0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:38.706185 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dba749-121c-410a-b8b5-380423d67ec0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:38.706607 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65dba749-121c-410a-b8b5-380423d67ec0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:38.834851 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-65dba749-121c-410a-b8b5-380423d67ec0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:38.842162 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-65dba749-121c-410a-b8b5-380423d67ec0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1564 microversion: 2.1 time: 0.150216 Aug 10 16:58:38.843226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 292/590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:38 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:38.863201 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8219d4d9-8b26-4470-aba5-8c6a659a0e57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:38.863684 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8219d4d9-8b26-4470-aba5-8c6a659a0e57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:38.869502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8219d4d9-8b26-4470-aba5-8c6a659a0e57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:38.870049 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8219d4d9-8b26-4470-aba5-8c6a659a0e57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:38.870479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8219d4d9-8b26-4470-aba5-8c6a659a0e57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:38.871151 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8219d4d9-8b26-4470-aba5-8c6a659a0e57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:38.871596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8219d4d9-8b26-4470-aba5-8c6a659a0e57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:38.872010 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8219d4d9-8b26-4470-aba5-8c6a659a0e57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:38.946803 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8219d4d9-8b26-4470-aba5-8c6a659a0e57 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087416 Aug 10 16:58:38.947446 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 299/591] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 10 16:58:38 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:58:39.138879 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-196bd49d-ab6a-4857-b6d3-833a521ebc6c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:39.139551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-196bd49d-ab6a-4857-b6d3-833a521ebc6c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:39.145496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-196bd49d-ab6a-4857-b6d3-833a521ebc6c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:39.145987 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-196bd49d-ab6a-4857-b6d3-833a521ebc6c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:39.146426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-196bd49d-ab6a-4857-b6d3-833a521ebc6c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:39.147122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-196bd49d-ab6a-4857-b6d3-833a521ebc6c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:39.147576 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-196bd49d-ab6a-4857-b6d3-833a521ebc6c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:39.148000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-196bd49d-ab6a-4857-b6d3-833a521ebc6c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:39.209218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1fac6c9d-13ad-4f1d-9ad6-b3b6648a5df8 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:39.209869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1fac6c9d-13ad-4f1d-9ad6-b3b6648a5df8 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:39.216185 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fac6c9d-13ad-4f1d-9ad6-b3b6648a5df8 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:39.216824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fac6c9d-13ad-4f1d-9ad6-b3b6648a5df8 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:39.217780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fac6c9d-13ad-4f1d-9ad6-b3b6648a5df8 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:39.218465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fac6c9d-13ad-4f1d-9ad6-b3b6648a5df8 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:39.218920 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fac6c9d-13ad-4f1d-9ad6-b3b6648a5df8 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:39.219343 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fac6c9d-13ad-4f1d-9ad6-b3b6648a5df8 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:39.276989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-196bd49d-ab6a-4857-b6d3-833a521ebc6c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:39.285726 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-196bd49d-ab6a-4857-b6d3-833a521ebc6c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.150735 Aug 10 16:58:39.286394 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 293/592] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:39 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:39.313516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1fac6c9d-13ad-4f1d-9ad6-b3b6648a5df8 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:39.321172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1fac6c9d-13ad-4f1d-9ad6-b3b6648a5df8 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1299 microversion: 2.1 time: 0.116338 Aug 10 16:58:39.321749 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 300/593] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:39 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:39.489118 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:39.489974 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:39.496015 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:39.496556 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:39.496987 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:39.497674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:39.498125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:39.498572 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:39.531983 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:39.532481 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:39.532913 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:39.533358 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lazy-loading 'fault' on Instance uuid bae55935-f47f-403d-80dc-416589153662 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:58:39.572643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:39.580528 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7267675d-549e-4f63-a77d-13cf34d3bc0f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1308 microversion: 2.1 time: 0.095354 Aug 10 16:58:39.581766 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 294/594] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:39 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:40.187662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-2d6093da-a760-4ab7-9847-2b8354813612 req-8e26c94a-60bb-40b6-b915-3baa0a87ec36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e3c08d-8649-4c99-8c7c-a57166ebc96b", "tag": "6d51b077-087c-428f-af01-0240852d1af2"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:40.197242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2d6093da-a760-4ab7-9847-2b8354813612 req-8e26c94a-60bb-40b6-b915-3baa0a87ec36 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:40.197714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2d6093da-a760-4ab7-9847-2b8354813612 req-8e26c94a-60bb-40b6-b915-3baa0a87ec36 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:40.198139 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2d6093da-a760-4ab7-9847-2b8354813612 req-8e26c94a-60bb-40b6-b915-3baa0a87ec36 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:40.209575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-2d6093da-a760-4ab7-9847-2b8354813612 req-8e26c94a-60bb-40b6-b915-3baa0a87ec36 service nova] Creating event network-changed:6d51b077-087c-428f-af01-0240852d1af2 for instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b on hv-cinder-83602 Aug 10 16:58:40.214337 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-2d6093da-a760-4ab7-9847-2b8354813612 req-8e26c94a-60bb-40b6-b915-3baa0a87ec36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030911 Aug 10 16:58:40.215076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 301/595] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:58:40.307079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-04b43f0f-6076-4682-a0c4-39e256d2cb6a tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:40.307800 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-04b43f0f-6076-4682-a0c4-39e256d2cb6a tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:40.314752 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b43f0f-6076-4682-a0c4-39e256d2cb6a tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:40.315234 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b43f0f-6076-4682-a0c4-39e256d2cb6a tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:40.315669 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b43f0f-6076-4682-a0c4-39e256d2cb6a tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:40.316391 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b43f0f-6076-4682-a0c4-39e256d2cb6a tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:40.316849 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b43f0f-6076-4682-a0c4-39e256d2cb6a tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:40.317274 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b43f0f-6076-4682-a0c4-39e256d2cb6a tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:40.346900 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-21283d1e-0466-4c92-be03-afc56d56fd0c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:40.347738 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-21283d1e-0466-4c92-be03-afc56d56fd0c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:40.354422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21283d1e-0466-4c92-be03-afc56d56fd0c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:40.354911 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21283d1e-0466-4c92-be03-afc56d56fd0c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:40.355341 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21283d1e-0466-4c92-be03-afc56d56fd0c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:40.356091 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21283d1e-0466-4c92-be03-afc56d56fd0c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:40.356506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21283d1e-0466-4c92-be03-afc56d56fd0c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:40.356928 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21283d1e-0466-4c92-be03-afc56d56fd0c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:40.427889 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-21283d1e-0466-4c92-be03-afc56d56fd0c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:40.437344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-21283d1e-0466-4c92-be03-afc56d56fd0c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1299 microversion: 2.1 time: 0.094713 Aug 10 16:58:40.438136 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 302/596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:40 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:40.462303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-04b43f0f-6076-4682-a0c4-39e256d2cb6a tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:40.470660 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-04b43f0f-6076-4682-a0c4-39e256d2cb6a tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.167478 Aug 10 16:58:40.471502 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 295/597] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:40 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:40.602751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:40.603355 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:40.609766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:40.610179 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:40.610607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:40.611287 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:40.611758 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:40.612194 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:40.641360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:40.641829 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:40.642307 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:40.642745 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lazy-loading 'fault' on Instance uuid bae55935-f47f-403d-80dc-416589153662 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:58:40.682474 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:40.690166 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-db1f4e95-9792-49d3-adf8-551ebbb822c5 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1308 microversion: 2.1 time: 0.091191 Aug 10 16:58:40.690792 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 303/598] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:40 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:41.459358 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02777663-36d7-49a0-9905-06735e907913 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:41.459968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-02777663-36d7-49a0-9905-06735e907913 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:41.466307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02777663-36d7-49a0-9905-06735e907913 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:41.466785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02777663-36d7-49a0-9905-06735e907913 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:41.467215 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02777663-36d7-49a0-9905-06735e907913 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:41.467949 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02777663-36d7-49a0-9905-06735e907913 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:41.468428 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02777663-36d7-49a0-9905-06735e907913 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:41.468849 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02777663-36d7-49a0-9905-06735e907913 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:41.472815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:41.492461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d9c7d06f-ead3-4469-afd7-91b6733017cc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:41.493068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d9c7d06f-ead3-4469-afd7-91b6733017cc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:41.499810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9c7d06f-ead3-4469-afd7-91b6733017cc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:41.500318 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9c7d06f-ead3-4469-afd7-91b6733017cc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:41.500744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9c7d06f-ead3-4469-afd7-91b6733017cc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:41.501432 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9c7d06f-ead3-4469-afd7-91b6733017cc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:41.501876 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9c7d06f-ead3-4469-afd7-91b6733017cc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:41.502290 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9c7d06f-ead3-4469-afd7-91b6733017cc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:41.530138 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-02777663-36d7-49a0-9905-06735e907913 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:41.537509 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-02777663-36d7-49a0-9905-06735e907913 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1299 microversion: 2.1 time: 0.082680 Aug 10 16:58:41.538072 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 296/599] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:41 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:41.634873 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d9c7d06f-ead3-4469-afd7-91b6733017cc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:41.642118 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d9c7d06f-ead3-4469-afd7-91b6733017cc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.153568 Aug 10 16:58:41.642677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 304/600] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:41 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:41.711447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:41.712084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:41.718009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:41.718485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:41.718917 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:41.719596 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:41.720044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:41.720487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:41.760233 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:41.760713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:41.761141 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:41.761583 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lazy-loading 'fault' on Instance uuid bae55935-f47f-403d-80dc-416589153662 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:58:41.800194 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:41.808203 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-870a6d18-891a-4330-a2d4-a9c43813819b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 200 len: 1308 microversion: 2.1 time: 0.100861 Aug 10 16:58:41.808779 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 297/601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:41 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:42.558283 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:42.558887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:42.565033 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:42.565515 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:42.565963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:42.566630 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:42.567084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:42.567502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:42.598125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:42.598601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:42.599033 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:42.599467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lazy-loading 'fault' on Instance uuid c067dba5-55d9-421c-badd-f6829a136d59 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:58:42.637729 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e2fc893e8a4424a77e0ca17f2920c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59727625ef364023997932413b8116f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:42.645483 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-21cce846-3f77-4c70-95a9-edc66a92bd6c tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 200 len: 1304 microversion: 2.1 time: 0.091108 Aug 10 16:58:42.646040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 305/602] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:42 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:42.662353 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b8d6d6f-8b5b-4581-9042-e73c535e2704 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:42.662890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b8d6d6f-8b5b-4581-9042-e73c535e2704 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:42.669308 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b8d6d6f-8b5b-4581-9042-e73c535e2704 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:42.669767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b8d6d6f-8b5b-4581-9042-e73c535e2704 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:42.670198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b8d6d6f-8b5b-4581-9042-e73c535e2704 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:42.670875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b8d6d6f-8b5b-4581-9042-e73c535e2704 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:42.671324 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b8d6d6f-8b5b-4581-9042-e73c535e2704 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:42.671743 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b8d6d6f-8b5b-4581-9042-e73c535e2704 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:42.832885 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:42.833627 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: bae55935-f47f-403d-80dc-416589153662] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:42.839863 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:42.840427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:42.840861 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:42.841617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:42.842599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:42.842599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:42.859304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] HTTP exception thrown: Instance bae55935-f47f-403d-80dc-416589153662 could not be found. Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Request method failure captured: Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 HTTP/1.1 Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-NSxCUjy1TwklpT1SvY5-4rsCt9SeDXMYHPcdsedwfHu2FhgpqFDCc4OeKcGWQNR-NCXtZIxX7i45yog_eLOOIgCAne9ZQkywYnerSLujmflfGYNn_ki6tHkxaqCD3sJlfIvHiywgimXK4rx5LKM6Fw-vHP1Ggt4E_8A6Aw4Q7EaPU Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: aa1a38abca5848b78518b882982fc1be Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesSnapshotTestJSON-733366104 Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:58:42.861007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aa1a38abca5848b78518b882982fc1be", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa1a38abca5848b78518b882982fc1be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa1a38abca5848b78518b882982fc1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aa1a38abca5848b78518b882982fc1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesSnapshotTestJSON-733366104 Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: aa1a38abca5848b78518b882982fc1be Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-733366104 Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesSnapshotTestJSON-733366104-project Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 409b789be2d9402885b2498435c76286 Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesSnapshotTestJSON-733366104-project Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance bae55935-f47f-403d-80dc-416589153662 could not be found. Aug 10 16:58:42.862260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'bae55935-f47f-403d-80dc-416589153662'} Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae55935-f47f-403d-80dc-416589153662 could not be found. Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:58:42.863013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae55935-f47f-403d-80dc-416589153662 could not be found. Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae55935-f47f-403d-80dc-416589153662 could not be found. Aug 10 16:58:42.864282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:58:42.865369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Returning 404 to user: Instance bae55935-f47f-403d-80dc-416589153662 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:58:42.865369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-952a773f-0ff7-47d0-9a9e-3cb850652242 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662" status: 404 len: 111 microversion: 2.1 time: 0.035623 Aug 10 16:58:42.865369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 306/603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:42 2022] GET /compute/v2.1/servers/bae55935-f47f-403d-80dc-416589153662 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 16:58:42.895965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b8d6d6f-8b5b-4581-9042-e73c535e2704 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:42.904316 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b8d6d6f-8b5b-4581-9042-e73c535e2704 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.245718 Aug 10 16:58:42.914322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 298/604] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:42 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:43.667367 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:43.668099 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] [instance: c067dba5-55d9-421c-badd-f6829a136d59] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:43.674679 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:43.675158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:43.675587 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:43.676332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:43.676785 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:43.677204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:43.691533 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] HTTP exception thrown: Instance c067dba5-55d9-421c-badd-f6829a136d59 could not be found. Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Request method failure captured: Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 HTTP/1.1 Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-OSOkSSUc5rLMzwRoWHyGop7KYv1ZTsNBIr-i5UpeFOrqS1IJbIeBrd5WIS82UHpKGNiIUVM7TpNpPYWJhO8Ue_tkwPSZ1OJ3CM8SVRARnMjPRld_qNMwKZMZQDPulv84RjA6dMl0r0LRMphjtYdRcigOyTu-nyk6D7Wr52zU8ZFg0 Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 59727625ef364023997932413b8116f2 Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesNegativeTest-189384662 Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:58:43.693265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_59727625ef364023997932413b8116f2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59727625ef364023997932413b8116f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59727625ef364023997932413b8116f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/59727625ef364023997932413b8116f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesNegativeTest-189384662 Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 59727625ef364023997932413b8116f2 Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesNegativeTest-189384662 Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesNegativeTest-189384662-project Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 58e2fc893e8a4424a77e0ca17f2920c6 Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesNegativeTest-189384662-project Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance c067dba5-55d9-421c-badd-f6829a136d59 could not be found. Aug 10 16:58:43.694940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'c067dba5-55d9-421c-badd-f6829a136d59'} Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c067dba5-55d9-421c-badd-f6829a136d59 could not be found. Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:58:43.695819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c067dba5-55d9-421c-badd-f6829a136d59 could not be found. Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c067dba5-55d9-421c-badd-f6829a136d59 could not be found. Aug 10 16:58:43.697390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:58:43.698786 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] Returning 404 to user: Instance c067dba5-55d9-421c-badd-f6829a136d59 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:58:43.698786 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-998500ff-86d0-4f6c-948a-3311c87ca8f5 tempest-VolumesNegativeTest-189384662 tempest-VolumesNegativeTest-189384662-project] 10.222.0.25 "GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59" status: 404 len: 111 microversion: 2.1 time: 0.031660 Aug 10 16:58:43.698786 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 307/605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:43 2022] GET /compute/v2.1/servers/c067dba5-55d9-421c-badd-f6829a136d59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:58:43.924842 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-70727653-b24c-4859-8fd1-a614030f1df7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:43.925474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-70727653-b24c-4859-8fd1-a614030f1df7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:43.931867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70727653-b24c-4859-8fd1-a614030f1df7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:43.932389 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70727653-b24c-4859-8fd1-a614030f1df7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:43.932827 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70727653-b24c-4859-8fd1-a614030f1df7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:43.933847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70727653-b24c-4859-8fd1-a614030f1df7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:43.934784 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70727653-b24c-4859-8fd1-a614030f1df7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:43.934784 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70727653-b24c-4859-8fd1-a614030f1df7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:44.065458 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-70727653-b24c-4859-8fd1-a614030f1df7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:44.072813 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-70727653-b24c-4859-8fd1-a614030f1df7 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.151844 Aug 10 16:58:44.073365 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 299/606] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:43 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:45.094513 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-34fd532d-4b33-416b-9079-74f747330cfa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:45.095116 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-34fd532d-4b33-416b-9079-74f747330cfa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:45.101128 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34fd532d-4b33-416b-9079-74f747330cfa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:45.101610 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34fd532d-4b33-416b-9079-74f747330cfa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:45.102042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34fd532d-4b33-416b-9079-74f747330cfa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:45.102727 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34fd532d-4b33-416b-9079-74f747330cfa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:45.103177 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34fd532d-4b33-416b-9079-74f747330cfa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:45.103598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34fd532d-4b33-416b-9079-74f747330cfa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:45.245279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-34fd532d-4b33-416b-9079-74f747330cfa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:45.253121 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-34fd532d-4b33-416b-9079-74f747330cfa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.162785 Aug 10 16:58:45.253669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 308/607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:45 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:46.273549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-62a7041c-6eaf-48bd-8ad2-ea0ae254347e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:46.274166 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-62a7041c-6eaf-48bd-8ad2-ea0ae254347e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:46.280673 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62a7041c-6eaf-48bd-8ad2-ea0ae254347e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:46.281236 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62a7041c-6eaf-48bd-8ad2-ea0ae254347e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:46.281684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62a7041c-6eaf-48bd-8ad2-ea0ae254347e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:46.282392 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62a7041c-6eaf-48bd-8ad2-ea0ae254347e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:46.282854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62a7041c-6eaf-48bd-8ad2-ea0ae254347e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:46.283446 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62a7041c-6eaf-48bd-8ad2-ea0ae254347e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:46.414935 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-62a7041c-6eaf-48bd-8ad2-ea0ae254347e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:46.422877 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-62a7041c-6eaf-48bd-8ad2-ea0ae254347e tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.153088 Aug 10 16:58:46.423444 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 300/608] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:46 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:47.443310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7b6a51eb-0966-41ae-8c2b-63a586fc2be2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:47.443916 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7b6a51eb-0966-41ae-8c2b-63a586fc2be2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:47.450131 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7b6a51eb-0966-41ae-8c2b-63a586fc2be2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:47.450611 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7b6a51eb-0966-41ae-8c2b-63a586fc2be2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:47.451040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7b6a51eb-0966-41ae-8c2b-63a586fc2be2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:47.451722 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7b6a51eb-0966-41ae-8c2b-63a586fc2be2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:47.452362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7b6a51eb-0966-41ae-8c2b-63a586fc2be2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:47.452804 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7b6a51eb-0966-41ae-8c2b-63a586fc2be2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:47.578987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7b6a51eb-0966-41ae-8c2b-63a586fc2be2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:47.586955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7b6a51eb-0966-41ae-8c2b-63a586fc2be2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.147519 Aug 10 16:58:47.587520 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 309/609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:47 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:48.607118 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-88b3c366-12be-4e27-a2f1-9abea295c917 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:48.608315 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-88b3c366-12be-4e27-a2f1-9abea295c917 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:48.614513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b3c366-12be-4e27-a2f1-9abea295c917 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:48.615083 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b3c366-12be-4e27-a2f1-9abea295c917 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:48.615443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b3c366-12be-4e27-a2f1-9abea295c917 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:48.616412 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b3c366-12be-4e27-a2f1-9abea295c917 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:48.616898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b3c366-12be-4e27-a2f1-9abea295c917 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:48.617456 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b3c366-12be-4e27-a2f1-9abea295c917 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:48.726375 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-bd01b561-f1b5-4956-bbb0-6f74434424f8 req-a2b95eca-ec6b-417d-b117-ecaa30854a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fd7777-3552-4a5f-b33a-cb1f0f356fd3", "name": "network-vif-plugged", "status": "completed", "tag": "9ab3c42c-77e3-4c02-b205-b6cc2e654956"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:48.743675 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-bd01b561-f1b5-4956-bbb0-6f74434424f8 req-a2b95eca-ec6b-417d-b117-ecaa30854a63 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:48.744398 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-bd01b561-f1b5-4956-bbb0-6f74434424f8 req-a2b95eca-ec6b-417d-b117-ecaa30854a63 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:48.745040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-bd01b561-f1b5-4956-bbb0-6f74434424f8 req-a2b95eca-ec6b-417d-b117-ecaa30854a63 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:48.762030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-bd01b561-f1b5-4956-bbb0-6f74434424f8 req-a2b95eca-ec6b-417d-b117-ecaa30854a63 service nova] Creating event network-vif-plugged:9ab3c42c-77e3-4c02-b205-b6cc2e654956 for instance a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 on hv-cinder-83602 Aug 10 16:58:48.768441 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-bd01b561-f1b5-4956-bbb0-6f74434424f8 req-a2b95eca-ec6b-417d-b117-ecaa30854a63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046116 Aug 10 16:58:48.769438 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 310/610] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:58:48.775261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-88b3c366-12be-4e27-a2f1-9abea295c917 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:48.783087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-88b3c366-12be-4e27-a2f1-9abea295c917 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.180149 Aug 10 16:58:48.783826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 301/611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:48 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:49.806574 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b8b0cc3e-0720-48c7-b27e-98193ac5a768 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:49.807208 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b8b0cc3e-0720-48c7-b27e-98193ac5a768 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:49.814216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8b0cc3e-0720-48c7-b27e-98193ac5a768 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:49.814777 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8b0cc3e-0720-48c7-b27e-98193ac5a768 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:49.815214 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8b0cc3e-0720-48c7-b27e-98193ac5a768 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:49.815906 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8b0cc3e-0720-48c7-b27e-98193ac5a768 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:49.816387 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8b0cc3e-0720-48c7-b27e-98193ac5a768 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:49.816809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8b0cc3e-0720-48c7-b27e-98193ac5a768 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:49.960660 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b8b0cc3e-0720-48c7-b27e-98193ac5a768 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:49.968275 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b8b0cc3e-0720-48c7-b27e-98193ac5a768 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.167773 Aug 10 16:58:49.968835 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 311/612] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:49 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:50.989561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4813b98d-a76a-4493-b941-04240ea58aaa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:50.990251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4813b98d-a76a-4493-b941-04240ea58aaa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:50.996859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4813b98d-a76a-4493-b941-04240ea58aaa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:50.997362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4813b98d-a76a-4493-b941-04240ea58aaa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:50.997783 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4813b98d-a76a-4493-b941-04240ea58aaa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:50.998481 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4813b98d-a76a-4493-b941-04240ea58aaa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:50.998934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4813b98d-a76a-4493-b941-04240ea58aaa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:50.999627 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4813b98d-a76a-4493-b941-04240ea58aaa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:51.251549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4813b98d-a76a-4493-b941-04240ea58aaa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:51.259531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4813b98d-a76a-4493-b941-04240ea58aaa tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.273782 Aug 10 16:58:51.270630 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 302/613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:50 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:52.282951 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-95089d09-5deb-40cc-95f9-a6e1ed33994c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:52.284197 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-95089d09-5deb-40cc-95f9-a6e1ed33994c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:52.292047 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95089d09-5deb-40cc-95f9-a6e1ed33994c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:52.292750 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95089d09-5deb-40cc-95f9-a6e1ed33994c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:52.293580 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95089d09-5deb-40cc-95f9-a6e1ed33994c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:52.294484 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95089d09-5deb-40cc-95f9-a6e1ed33994c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:52.295096 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95089d09-5deb-40cc-95f9-a6e1ed33994c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:52.295685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95089d09-5deb-40cc-95f9-a6e1ed33994c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:52.490591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-95089d09-5deb-40cc-95f9-a6e1ed33994c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:52.499042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-95089d09-5deb-40cc-95f9-a6e1ed33994c tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.221910 Aug 10 16:58:52.499879 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 312/614] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:52 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:53.521249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-27f839cb-cddb-4b0f-9c74-2277712a7ae4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:53.523345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-27f839cb-cddb-4b0f-9c74-2277712a7ae4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:53.535638 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f839cb-cddb-4b0f-9c74-2277712a7ae4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:53.538041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f839cb-cddb-4b0f-9c74-2277712a7ae4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:53.538041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f839cb-cddb-4b0f-9c74-2277712a7ae4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:53.538041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f839cb-cddb-4b0f-9c74-2277712a7ae4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:53.538997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f839cb-cddb-4b0f-9c74-2277712a7ae4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:53.539522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f839cb-cddb-4b0f-9c74-2277712a7ae4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:53.759863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-27f839cb-cddb-4b0f-9c74-2277712a7ae4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:53.768506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-27f839cb-cddb-4b0f-9c74-2277712a7ae4 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.251101 Aug 10 16:58:53.769134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 303/615] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:53 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:54.803833 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-15708138-4731-48c2-a8f4-a2dfe1d7aad6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:54.805337 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-15708138-4731-48c2-a8f4-a2dfe1d7aad6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:54.811838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15708138-4731-48c2-a8f4-a2dfe1d7aad6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:54.812360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15708138-4731-48c2-a8f4-a2dfe1d7aad6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:54.813024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15708138-4731-48c2-a8f4-a2dfe1d7aad6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:54.813910 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15708138-4731-48c2-a8f4-a2dfe1d7aad6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:54.814512 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15708138-4731-48c2-a8f4-a2dfe1d7aad6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:54.815084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15708138-4731-48c2-a8f4-a2dfe1d7aad6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:54.948859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1963962645", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "networks": [{"uuid": "a890585f-f9c7-4b89-b5fa-39a66c9493c1"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:58:55.027000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] validate_networks() for [('a890585f-f9c7-4b89-b5fa-39a66c9493c1', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:58:55.042461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-15708138-4731-48c2-a8f4-a2dfe1d7aad6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:55.050281 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-15708138-4731-48c2-a8f4-a2dfe1d7aad6 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1313 microversion: 2.1 time: 0.250317 Aug 10 16:58:55.051031 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 313/616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:54 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:55.767742 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:58:55.768455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:58:55.769100 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:58:55.769511 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:58:55.769947 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:58:55.779786 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:55.780315 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:55.780931 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:55.782026 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:55.782643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:55.783076 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:55.804103 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Getting quotas for project aa1a38abca5848b78518b882982fc1be. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:58:55.808524 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Getting quotas for user 409b789be2d9402885b2498435c76286 and project aa1a38abca5848b78518b882982fc1be. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:58:55.822271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:58:55.825037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:58:55.879472 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a1ffe03e-8200-4ab6-aa46-fae0b02bed90 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934366 Aug 10 16:58:55.880478 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 304/617] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:58:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 16:58:55.891297 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7938b73b-b918-4f90-9183-f804a6f2a0ac tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:55.892672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7938b73b-b918-4f90-9183-f804a6f2a0ac tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:56.072898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc998ba6-4250-4045-9d8b-7baa206f81ca tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:56.073545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc998ba6-4250-4045-9d8b-7baa206f81ca tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:56.085544 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc998ba6-4250-4045-9d8b-7baa206f81ca tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:56.086351 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc998ba6-4250-4045-9d8b-7baa206f81ca tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:56.087169 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc998ba6-4250-4045-9d8b-7baa206f81ca tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:56.094784 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc998ba6-4250-4045-9d8b-7baa206f81ca tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:56.095660 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc998ba6-4250-4045-9d8b-7baa206f81ca tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:56.096557 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc998ba6-4250-4045-9d8b-7baa206f81ca tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:56.097779 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7938b73b-b918-4f90-9183-f804a6f2a0ac tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:56.116641 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7938b73b-b918-4f90-9183-f804a6f2a0ac tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1219 microversion: 2.1 time: 0.228716 Aug 10 16:58:56.118918 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 314/618] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:55 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1219 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:56.290293 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-cc998ba6-4250-4045-9d8b-7baa206f81ca tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:56.301084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc998ba6-4250-4045-9d8b-7baa206f81ca tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1497 microversion: 2.1 time: 0.233060 Aug 10 16:58:56.301753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 305/619] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:56 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1497 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:57.049994 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cdaebf1b-1d91-482a-bc17-32cfceaba802 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:57.051338 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cdaebf1b-1d91-482a-bc17-32cfceaba802 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:57.059400 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cdaebf1b-1d91-482a-bc17-32cfceaba802 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:57.060316 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cdaebf1b-1d91-482a-bc17-32cfceaba802 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:57.060974 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cdaebf1b-1d91-482a-bc17-32cfceaba802 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:57.064091 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cdaebf1b-1d91-482a-bc17-32cfceaba802 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:57.064757 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cdaebf1b-1d91-482a-bc17-32cfceaba802 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:57.065373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cdaebf1b-1d91-482a-bc17-32cfceaba802 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:57.112860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cdaebf1b-1d91-482a-bc17-32cfceaba802 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 16:58:57.141805 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f86c37ed-dc52-4f54-b4b6-571252c162ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:57.143032 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f86c37ed-dc52-4f54-b4b6-571252c162ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:57.166277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f86c37ed-dc52-4f54-b4b6-571252c162ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:57.167018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f86c37ed-dc52-4f54-b4b6-571252c162ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:57.167697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f86c37ed-dc52-4f54-b4b6-571252c162ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:57.168583 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f86c37ed-dc52-4f54-b4b6-571252c162ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:57.169213 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f86c37ed-dc52-4f54-b4b6-571252c162ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:57.169780 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f86c37ed-dc52-4f54-b4b6-571252c162ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:57.246174 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:58:57.357712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cdaebf1b-1d91-482a-bc17-32cfceaba802 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 204 len: 0 microversion: 2.1 time: 0.311301 Aug 10 16:58:57.359861 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 315/620] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 16:58:57 2022] DELETE /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 16:58:57.368653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f86c37ed-dc52-4f54-b4b6-571252c162ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:57.370821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1b059aa3-bb50-4e8e-b15a-2c41296430e2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:57.371796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1b059aa3-bb50-4e8e-b15a-2c41296430e2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:57.382112 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f86c37ed-dc52-4f54-b4b6-571252c162ad tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1271 microversion: 2.1 time: 0.244630 Aug 10 16:58:57.384231 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 306/621] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:57 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:57.393677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b059aa3-bb50-4e8e-b15a-2c41296430e2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:57.394179 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b059aa3-bb50-4e8e-b15a-2c41296430e2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:57.394610 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b059aa3-bb50-4e8e-b15a-2c41296430e2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:57.400616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b059aa3-bb50-4e8e-b15a-2c41296430e2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:57.401404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b059aa3-bb50-4e8e-b15a-2c41296430e2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:57.402020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b059aa3-bb50-4e8e-b15a-2c41296430e2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:57.631314 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1b059aa3-bb50-4e8e-b15a-2c41296430e2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:57.640755 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1b059aa3-bb50-4e8e-b15a-2c41296430e2 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1503 microversion: 2.1 time: 0.275058 Aug 10 16:58:57.642077 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 316/622] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:57 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:58:58.402853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-38904e9e-f12a-4e22-a6ce-e47bcf1be429 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:58.404079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-38904e9e-f12a-4e22-a6ce-e47bcf1be429 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:58.416396 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38904e9e-f12a-4e22-a6ce-e47bcf1be429 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:58.417070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38904e9e-f12a-4e22-a6ce-e47bcf1be429 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:58.417667 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38904e9e-f12a-4e22-a6ce-e47bcf1be429 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:58.421142 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38904e9e-f12a-4e22-a6ce-e47bcf1be429 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:58.422417 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38904e9e-f12a-4e22-a6ce-e47bcf1be429 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:58.423021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38904e9e-f12a-4e22-a6ce-e47bcf1be429 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:58.525158 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-38904e9e-f12a-4e22-a6ce-e47bcf1be429 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:58.532980 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-38904e9e-f12a-4e22-a6ce-e47bcf1be429 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1279 microversion: 2.1 time: 0.133917 Aug 10 16:58:58.534055 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 307/623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:58 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1279 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:58.661109 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8b6eb3f2-e5f8-49d8-a7da-f2cedbec9c60 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:58.662376 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8b6eb3f2-e5f8-49d8-a7da-f2cedbec9c60 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:58.670336 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b6eb3f2-e5f8-49d8-a7da-f2cedbec9c60 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:58.672250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b6eb3f2-e5f8-49d8-a7da-f2cedbec9c60 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:58.672771 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b6eb3f2-e5f8-49d8-a7da-f2cedbec9c60 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:58.673576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b6eb3f2-e5f8-49d8-a7da-f2cedbec9c60 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:58.674305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b6eb3f2-e5f8-49d8-a7da-f2cedbec9c60 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:58.675670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b6eb3f2-e5f8-49d8-a7da-f2cedbec9c60 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:58.949044 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8b6eb3f2-e5f8-49d8-a7da-f2cedbec9c60 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:58.988077 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8b6eb3f2-e5f8-49d8-a7da-f2cedbec9c60 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1503 microversion: 2.1 time: 0.329189 Aug 10 16:58:58.989378 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 317/624] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:58 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:58:59.554542 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cce94583-01fd-4c00-91ac-5cb4794360ef tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:58:59.555140 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cce94583-01fd-4c00-91ac-5cb4794360ef tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:58:59.561828 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cce94583-01fd-4c00-91ac-5cb4794360ef tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:59.562309 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cce94583-01fd-4c00-91ac-5cb4794360ef tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:59.563918 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cce94583-01fd-4c00-91ac-5cb4794360ef tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:59.564660 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cce94583-01fd-4c00-91ac-5cb4794360ef tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:58:59.565347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cce94583-01fd-4c00-91ac-5cb4794360ef tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:58:59.565878 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cce94583-01fd-4c00-91ac-5cb4794360ef tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:58:59.690282 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-cce94583-01fd-4c00-91ac-5cb4794360ef tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:58:59.699035 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cce94583-01fd-4c00-91ac-5cb4794360ef tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1277 microversion: 2.1 time: 0.148554 Aug 10 16:58:59.700117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 308/625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:58:59 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:00.016807 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8faa4c2c-7532-4392-9721-4f950ab86673 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:00.016807 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8faa4c2c-7532-4392-9721-4f950ab86673 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:00.031938 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8faa4c2c-7532-4392-9721-4f950ab86673 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:00.037339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8faa4c2c-7532-4392-9721-4f950ab86673 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:00.042250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8faa4c2c-7532-4392-9721-4f950ab86673 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:00.044654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8faa4c2c-7532-4392-9721-4f950ab86673 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:00.045192 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8faa4c2c-7532-4392-9721-4f950ab86673 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:00.048454 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8faa4c2c-7532-4392-9721-4f950ab86673 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:00.507562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8faa4c2c-7532-4392-9721-4f950ab86673 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:00.519275 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8faa4c2c-7532-4392-9721-4f950ab86673 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1503 microversion: 2.1 time: 0.509231 Aug 10 16:59:00.535012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 318/626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:00 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1503 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:00.722443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3135cea3-5f93-4f9d-868b-070074146f69 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:00.723048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3135cea3-5f93-4f9d-868b-070074146f69 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:00.733561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3135cea3-5f93-4f9d-868b-070074146f69 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:00.734049 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3135cea3-5f93-4f9d-868b-070074146f69 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:00.734520 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3135cea3-5f93-4f9d-868b-070074146f69 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:00.735425 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3135cea3-5f93-4f9d-868b-070074146f69 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:00.735873 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3135cea3-5f93-4f9d-868b-070074146f69 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:00.736668 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3135cea3-5f93-4f9d-868b-070074146f69 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:01.022367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-3135cea3-5f93-4f9d-868b-070074146f69 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:01.029884 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3135cea3-5f93-4f9d-868b-070074146f69 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.311270 Aug 10 16:59:01.030473 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 309/627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:00 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:59:01.049760 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-5aa609ea-1029-497a-ad7a-75c4df910bde req-8571b1d9-83dc-46b9-842e-9a4891f9ac45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fd7777-3552-4a5f-b33a-cb1f0f356fd3", "name": "network-vif-deleted", "tag": "9ab3c42c-77e3-4c02-b205-b6cc2e654956"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:01.061693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5aa609ea-1029-497a-ad7a-75c4df910bde req-8571b1d9-83dc-46b9-842e-9a4891f9ac45 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:01.063004 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5aa609ea-1029-497a-ad7a-75c4df910bde req-8571b1d9-83dc-46b9-842e-9a4891f9ac45 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:01.064653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5aa609ea-1029-497a-ad7a-75c4df910bde req-8571b1d9-83dc-46b9-842e-9a4891f9ac45 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:01.082121 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-5aa609ea-1029-497a-ad7a-75c4df910bde req-8571b1d9-83dc-46b9-842e-9a4891f9ac45 service nova] Creating event network-vif-deleted:9ab3c42c-77e3-4c02-b205-b6cc2e654956 for instance a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 on hv-cinder-83602 Aug 10 16:59:01.089705 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-5aa609ea-1029-497a-ad7a-75c4df910bde req-8571b1d9-83dc-46b9-842e-9a4891f9ac45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043905 Aug 10 16:59:01.090587 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 310/628] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:59:01.111389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7f81bbf7-ed23-4372-9d6c-4d5e52e3c450 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Action: 'create', calling method: .version_select at 0x7f5b08430ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-465937417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc6JUIwN/0xav0COAGmBjQj36oYUodbVuZcyDQaFrsxs9vHsIU7QcnJDGq6whEqyeOVF0CHUe9Ha69KWPsU4j210M6XuG98rzFtvQZzPIA8wxGYhKRLzycL+n7e1C6ojQ=="}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:01.137475 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-7f81bbf7-ed23-4372-9d6c-4d5e52e3c450 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Getting quotas for project 41311d9aa3f54596a61033b0ea82ba80. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:59:01.141796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-7f81bbf7-ed23-4372-9d6c-4d5e52e3c450 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Getting quotas for user a1c78f05a0f24151a1884faed65d286e and project 41311d9aa3f54596a61033b0ea82ba80. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:59:01.184751 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ce364054-fc9f-4f89-9bad-35320fd37c02 req-bf51bcdf-eee7-4b2c-9fdd-47084638c91c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e4f0e3-d478-4828-b569-74b375839bf6", "tag": "58a6c42f-3908-40df-96bd-f071dc3f136d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:01.187111 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7f81bbf7-ed23-4372-9d6c-4d5e52e3c450 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.360338 Aug 10 16:59:01.188571 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 319/629] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 10 16:59:00 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:59:01.197920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ce364054-fc9f-4f89-9bad-35320fd37c02 req-bf51bcdf-eee7-4b2c-9fdd-47084638c91c service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:01.198723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ce364054-fc9f-4f89-9bad-35320fd37c02 req-bf51bcdf-eee7-4b2c-9fdd-47084638c91c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:01.199294 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ce364054-fc9f-4f89-9bad-35320fd37c02 req-bf51bcdf-eee7-4b2c-9fdd-47084638c91c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:01.212264 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ce364054-fc9f-4f89-9bad-35320fd37c02 req-bf51bcdf-eee7-4b2c-9fdd-47084638c91c service nova] Creating event network-changed:58a6c42f-3908-40df-96bd-f071dc3f136d for instance f9e4f0e3-d478-4828-b569-74b375839bf6 on hv-cinder-83602 Aug 10 16:59:01.217863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ce364054-fc9f-4f89-9bad-35320fd37c02 req-bf51bcdf-eee7-4b2c-9fdd-47084638c91c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038750 Aug 10 16:59:01.219195 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 311/630] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:59:01.541593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:01.542441 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:01.550199 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:01.550699 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:01.551126 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:01.552040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:01.552525 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:01.553602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:01.611801 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:01.612578 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:01.613157 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:01.613798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lazy-loading 'fault' on Instance uuid a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:59:01.682567 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f341b9aff4b7db13e429b86ba145e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe3003a0c91471e9982327ac5e17b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:01.693432 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-02e588eb-8c60-4143-96eb-a30cf9775154 tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 200 len: 1303 microversion: 2.1 time: 0.155932 Aug 10 16:59:01.694018 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 320/631] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:01 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:02.051117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4d48fb91-43c0-4d93-8560-329b65859665 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:02.051807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d48fb91-43c0-4d93-8560-329b65859665 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:02.058952 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d48fb91-43c0-4d93-8560-329b65859665 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:02.059724 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d48fb91-43c0-4d93-8560-329b65859665 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:02.060432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d48fb91-43c0-4d93-8560-329b65859665 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:02.062107 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d48fb91-43c0-4d93-8560-329b65859665 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:02.063384 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d48fb91-43c0-4d93-8560-329b65859665 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:02.064002 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d48fb91-43c0-4d93-8560-329b65859665 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:02.330577 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d48fb91-43c0-4d93-8560-329b65859665 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:02.338822 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4d48fb91-43c0-4d93-8560-329b65859665 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.291801 Aug 10 16:59:02.351995 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 312/632] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:02 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:59:02.715923 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:02.716593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] [instance: a8fd7777-3552-4a5f-b33a-cb1f0f356fd3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:02.725440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:02.725938 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:02.726373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:02.727114 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:02.727568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:02.730375 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:02.755142 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] HTTP exception thrown: Instance a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 could not be found. Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Request method failure captured: Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 HTTP/1.1 Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-N01IZSPy2E_i8Ya5gfknCxVwJSJofAnLxqdKs5Z9K9k24DEJN0MFcxKd0kbQ38z99r45y3WEWP7SMiaVNYbGtzBgCXOg2fgmSbCvx3yamYXbVfOION7j-ivzosMxlx1zeWeGQJ4D5kKbp9tdtFBuE4MiI0q7VA9mEMOAMOzxSeWFc Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: abe3003a0c91471e9982327ac5e17b9e Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesActionsTest-1698967808 Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 16:59:02.757035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_abe3003a0c91471e9982327ac5e17b9e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abe3003a0c91471e9982327ac5e17b9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abe3003a0c91471e9982327ac5e17b9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/abe3003a0c91471e9982327ac5e17b9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesActionsTest-1698967808 Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: abe3003a0c91471e9982327ac5e17b9e Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesActionsTest-1698967808 Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesActionsTest-1698967808-project Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 5d1f341b9aff4b7db13e429b86ba145e Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesActionsTest-1698967808-project Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 could not be found. Aug 10 16:59:02.758697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'a8fd7777-3552-4a5f-b33a-cb1f0f356fd3'} Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 could not be found. Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 16:59:02.759592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 could not be found. Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 could not be found. Aug 10 16:59:02.761024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 16:59:02.763247 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] Returning 404 to user: Instance a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 16:59:02.764301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-503c4cc4-67a3-4ef5-a994-882e0c8bfddc tempest-VolumesActionsTest-1698967808 tempest-VolumesActionsTest-1698967808-project] 10.222.0.25 "GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3" status: 404 len: 111 microversion: 2.1 time: 0.052940 Aug 10 16:59:02.765513 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 321/633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:02 2022] GET /compute/v2.1/servers/a8fd7777-3552-4a5f-b33a-cb1f0f356fd3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 16:59:03.360936 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-07f0b045-ef58-4015-9f79-f1bcaa44ad7f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:03.361701 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-07f0b045-ef58-4015-9f79-f1bcaa44ad7f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:03.377662 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:03.395259 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07f0b045-ef58-4015-9f79-f1bcaa44ad7f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:03.398320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07f0b045-ef58-4015-9f79-f1bcaa44ad7f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:03.398798 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07f0b045-ef58-4015-9f79-f1bcaa44ad7f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:03.399532 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07f0b045-ef58-4015-9f79-f1bcaa44ad7f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:03.400179 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07f0b045-ef58-4015-9f79-f1bcaa44ad7f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:03.400609 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07f0b045-ef58-4015-9f79-f1bcaa44ad7f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:03.606375 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-07f0b045-ef58-4015-9f79-f1bcaa44ad7f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:03.613958 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-07f0b045-ef58-4015-9f79-f1bcaa44ad7f tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.258918 Aug 10 16:59:03.615107 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 313/634] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:03 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:59:04.634926 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d799516e-5a37-47e8-b055-55b0504f0c97 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:04.635459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d799516e-5a37-47e8-b055-55b0504f0c97 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:04.641605 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d799516e-5a37-47e8-b055-55b0504f0c97 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:04.642118 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d799516e-5a37-47e8-b055-55b0504f0c97 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:04.642563 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d799516e-5a37-47e8-b055-55b0504f0c97 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:04.643248 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d799516e-5a37-47e8-b055-55b0504f0c97 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:04.643718 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d799516e-5a37-47e8-b055-55b0504f0c97 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:04.644167 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d799516e-5a37-47e8-b055-55b0504f0c97 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:04.775128 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d799516e-5a37-47e8-b055-55b0504f0c97 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:04.783839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d799516e-5a37-47e8-b055-55b0504f0c97 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.152735 Aug 10 16:59:04.784440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 322/635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:04 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:05.804497 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47138fca-f920-4f87-906a-18a99b7e2cab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:05.805636 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47138fca-f920-4f87-906a-18a99b7e2cab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:05.809249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:05.812764 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47138fca-f920-4f87-906a-18a99b7e2cab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:05.813256 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47138fca-f920-4f87-906a-18a99b7e2cab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:05.813694 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47138fca-f920-4f87-906a-18a99b7e2cab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:05.814975 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47138fca-f920-4f87-906a-18a99b7e2cab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:05.815434 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47138fca-f920-4f87-906a-18a99b7e2cab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:05.815859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47138fca-f920-4f87-906a-18a99b7e2cab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:05.816637 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:05.835063 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:05.949530 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-47138fca-f920-4f87-906a-18a99b7e2cab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:05.957058 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47138fca-f920-4f87-906a-18a99b7e2cab tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.156315 Aug 10 16:59:05.957620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 314/636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:05 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:06.978743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-01eaec81-c448-4011-a3d4-96f92c465804 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:06.979424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-01eaec81-c448-4011-a3d4-96f92c465804 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:06.985311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01eaec81-c448-4011-a3d4-96f92c465804 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:06.985787 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01eaec81-c448-4011-a3d4-96f92c465804 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:06.986896 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01eaec81-c448-4011-a3d4-96f92c465804 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:06.987572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01eaec81-c448-4011-a3d4-96f92c465804 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:06.988009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01eaec81-c448-4011-a3d4-96f92c465804 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:06.988447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01eaec81-c448-4011-a3d4-96f92c465804 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:07.130255 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-01eaec81-c448-4011-a3d4-96f92c465804 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:07.137723 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-01eaec81-c448-4011-a3d4-96f92c465804 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.162781 Aug 10 16:59:07.138285 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 323/637] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:06 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:08.159899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-757cc3ec-e06e-431d-b9c6-a7eca27204f4 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:08.160470 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-757cc3ec-e06e-431d-b9c6-a7eca27204f4 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:08.167029 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-757cc3ec-e06e-431d-b9c6-a7eca27204f4 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:08.167543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-757cc3ec-e06e-431d-b9c6-a7eca27204f4 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:08.167971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-757cc3ec-e06e-431d-b9c6-a7eca27204f4 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:08.169008 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-757cc3ec-e06e-431d-b9c6-a7eca27204f4 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:08.169545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-757cc3ec-e06e-431d-b9c6-a7eca27204f4 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:08.169970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-757cc3ec-e06e-431d-b9c6-a7eca27204f4 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:08.297724 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-757cc3ec-e06e-431d-b9c6-a7eca27204f4 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:08.304968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-757cc3ec-e06e-431d-b9c6-a7eca27204f4 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.149112 Aug 10 16:59:08.305522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 315/638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:08 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:09.326059 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e7e939af-24b4-4f14-8f1a-f08e8eab1453 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:09.326660 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e7e939af-24b4-4f14-8f1a-f08e8eab1453 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:09.328628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:09.333919 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7e939af-24b4-4f14-8f1a-f08e8eab1453 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:09.334392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7e939af-24b4-4f14-8f1a-f08e8eab1453 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:09.334818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7e939af-24b4-4f14-8f1a-f08e8eab1453 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:09.335495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7e939af-24b4-4f14-8f1a-f08e8eab1453 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:09.335938 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7e939af-24b4-4f14-8f1a-f08e8eab1453 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:09.336379 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7e939af-24b4-4f14-8f1a-f08e8eab1453 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:09.478444 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e7e939af-24b4-4f14-8f1a-f08e8eab1453 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:09.486692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e7e939af-24b4-4f14-8f1a-f08e8eab1453 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.163907 Aug 10 16:59:09.487428 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 324/639] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:09 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:10.507416 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-168cffd8-0365-4519-b16a-90776eae6a87 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:10.508053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-168cffd8-0365-4519-b16a-90776eae6a87 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:10.514432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-168cffd8-0365-4519-b16a-90776eae6a87 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:10.514915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-168cffd8-0365-4519-b16a-90776eae6a87 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:10.515354 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-168cffd8-0365-4519-b16a-90776eae6a87 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:10.516037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-168cffd8-0365-4519-b16a-90776eae6a87 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:10.516521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-168cffd8-0365-4519-b16a-90776eae6a87 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:10.516945 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-168cffd8-0365-4519-b16a-90776eae6a87 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:10.651720 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-168cffd8-0365-4519-b16a-90776eae6a87 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:10.659039 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-168cffd8-0365-4519-b16a-90776eae6a87 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.155594 Aug 10 16:59:10.659606 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 316/640] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:10 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:11.679162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-541a4385-49ad-417b-86e5-695e7c372e65 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:11.679762 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-541a4385-49ad-417b-86e5-695e7c372e65 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:11.681589 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:11.687168 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-541a4385-49ad-417b-86e5-695e7c372e65 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:11.687770 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-541a4385-49ad-417b-86e5-695e7c372e65 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:11.688281 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-541a4385-49ad-417b-86e5-695e7c372e65 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:11.689012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-541a4385-49ad-417b-86e5-695e7c372e65 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:11.689907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-541a4385-49ad-417b-86e5-695e7c372e65 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:11.689907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-541a4385-49ad-417b-86e5-695e7c372e65 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:11.819928 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-541a4385-49ad-417b-86e5-695e7c372e65 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:11.827181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-541a4385-49ad-417b-86e5-695e7c372e65 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.151800 Aug 10 16:59:11.827733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 325/641] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:11 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:12.846815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-269691b4-26d3-4e75-a558-24fece4f2b06 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:12.847489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-269691b4-26d3-4e75-a558-24fece4f2b06 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:12.855030 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-269691b4-26d3-4e75-a558-24fece4f2b06 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:12.855538 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-269691b4-26d3-4e75-a558-24fece4f2b06 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:12.855972 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-269691b4-26d3-4e75-a558-24fece4f2b06 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:12.856694 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-269691b4-26d3-4e75-a558-24fece4f2b06 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:12.857150 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-269691b4-26d3-4e75-a558-24fece4f2b06 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:12.857570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-269691b4-26d3-4e75-a558-24fece4f2b06 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:13.008469 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-269691b4-26d3-4e75-a558-24fece4f2b06 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:13.018427 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-269691b4-26d3-4e75-a558-24fece4f2b06 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.175421 Aug 10 16:59:13.020208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 317/642] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:12 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:59:14.042899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ff35fa4f-ff5e-4a8d-8281-a76eecce9da0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:14.044343 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ff35fa4f-ff5e-4a8d-8281-a76eecce9da0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:14.051227 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff35fa4f-ff5e-4a8d-8281-a76eecce9da0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:14.051714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff35fa4f-ff5e-4a8d-8281-a76eecce9da0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:14.052169 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff35fa4f-ff5e-4a8d-8281-a76eecce9da0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:14.052857 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff35fa4f-ff5e-4a8d-8281-a76eecce9da0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:14.053299 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff35fa4f-ff5e-4a8d-8281-a76eecce9da0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:14.053962 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff35fa4f-ff5e-4a8d-8281-a76eecce9da0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:14.200449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ff35fa4f-ff5e-4a8d-8281-a76eecce9da0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:14.213042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ff35fa4f-ff5e-4a8d-8281-a76eecce9da0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.173765 Aug 10 16:59:14.213619 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 326/643] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:14 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:14.595252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-69234e3e-248a-4b72-aa29-47a37c8f6dd4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:14.595899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-69234e3e-248a-4b72-aa29-47a37c8f6dd4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:14.602776 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69234e3e-248a-4b72-aa29-47a37c8f6dd4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:14.603200 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69234e3e-248a-4b72-aa29-47a37c8f6dd4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:14.603637 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69234e3e-248a-4b72-aa29-47a37c8f6dd4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:14.604359 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69234e3e-248a-4b72-aa29-47a37c8f6dd4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:14.604975 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69234e3e-248a-4b72-aa29-47a37c8f6dd4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:14.605412 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69234e3e-248a-4b72-aa29-47a37c8f6dd4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:14.629554 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-69234e3e-248a-4b72-aa29-47a37c8f6dd4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/ips" status: 200 len: 152 microversion: 2.20 time: 0.038108 Aug 10 16:59:14.630127 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 318/644] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Aug 10 16:59:14 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 16:59:15.234703 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a032c453-7936-4b55-b91b-03b2c1635d7b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:15.235300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a032c453-7936-4b55-b91b-03b2c1635d7b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:15.241369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a032c453-7936-4b55-b91b-03b2c1635d7b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:15.241849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a032c453-7936-4b55-b91b-03b2c1635d7b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:15.242637 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a032c453-7936-4b55-b91b-03b2c1635d7b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:15.242958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a032c453-7936-4b55-b91b-03b2c1635d7b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:15.243403 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a032c453-7936-4b55-b91b-03b2c1635d7b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:15.243824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a032c453-7936-4b55-b91b-03b2c1635d7b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:15.377527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a032c453-7936-4b55-b91b-03b2c1635d7b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:15.385369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a032c453-7936-4b55-b91b-03b2c1635d7b tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.154471 Aug 10 16:59:15.386009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 327/645] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:15 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:16.413289 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2169f5fb-5a14-4230-a522-d104f1ff73f9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:16.414624 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2169f5fb-5a14-4230-a522-d104f1ff73f9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:16.425551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2169f5fb-5a14-4230-a522-d104f1ff73f9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:16.426431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2169f5fb-5a14-4230-a522-d104f1ff73f9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:16.427119 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2169f5fb-5a14-4230-a522-d104f1ff73f9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:16.428217 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2169f5fb-5a14-4230-a522-d104f1ff73f9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:16.428903 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2169f5fb-5a14-4230-a522-d104f1ff73f9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:16.429537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2169f5fb-5a14-4230-a522-d104f1ff73f9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:16.580964 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2169f5fb-5a14-4230-a522-d104f1ff73f9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:16.589089 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2169f5fb-5a14-4230-a522-d104f1ff73f9 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.180195 Aug 10 16:59:16.589807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 319/646] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:16 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:16.897094 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c138ff85-3204-4845-be2a-35d4a406365d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:16.897721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c138ff85-3204-4845-be2a-35d4a406365d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:16.904266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c138ff85-3204-4845-be2a-35d4a406365d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:16.904529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c138ff85-3204-4845-be2a-35d4a406365d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:16.904957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c138ff85-3204-4845-be2a-35d4a406365d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:16.905645 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c138ff85-3204-4845-be2a-35d4a406365d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:16.906083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c138ff85-3204-4845-be2a-35d4a406365d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:16.906688 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c138ff85-3204-4845-be2a-35d4a406365d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:16.914007 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-bc0665c6-c148-438e-854b-f00cd1a6bbe3 req-a49cc880-d06a-4430-a040-8525c782564f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e4f0e3-d478-4828-b569-74b375839bf6", "name": "network-vif-plugged", "status": "completed", "tag": "58a6c42f-3908-40df-96bd-f071dc3f136d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:16.927757 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bc0665c6-c148-438e-854b-f00cd1a6bbe3 req-a49cc880-d06a-4430-a040-8525c782564f service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:16.928940 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bc0665c6-c148-438e-854b-f00cd1a6bbe3 req-a49cc880-d06a-4430-a040-8525c782564f service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:16.929603 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bc0665c6-c148-438e-854b-f00cd1a6bbe3 req-a49cc880-d06a-4430-a040-8525c782564f service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:16.934663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c138ff85-3204-4845-be2a-35d4a406365d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/ips" status: 200 len: 149 microversion: 2.1 time: 0.052013 Aug 10 16:59:16.935550 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 328/647] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 10 16:59:16 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:59:16.964374 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-bc0665c6-c148-438e-854b-f00cd1a6bbe3 req-a49cc880-d06a-4430-a040-8525c782564f service nova] Creating event network-vif-plugged:58a6c42f-3908-40df-96bd-f071dc3f136d for instance f9e4f0e3-d478-4828-b569-74b375839bf6 on hv-cinder-83602 Aug 10 16:59:16.970153 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-bc0665c6-c148-438e-854b-f00cd1a6bbe3 req-a49cc880-d06a-4430-a040-8525c782564f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059959 Aug 10 16:59:16.984987 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 320/648] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:59:17.619032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-197051f4-7239-4a05-a8e4-52d5dc95b4cf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:17.619568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-197051f4-7239-4a05-a8e4-52d5dc95b4cf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:17.625765 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-197051f4-7239-4a05-a8e4-52d5dc95b4cf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:17.626269 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-197051f4-7239-4a05-a8e4-52d5dc95b4cf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:17.626885 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-197051f4-7239-4a05-a8e4-52d5dc95b4cf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:17.628183 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-197051f4-7239-4a05-a8e4-52d5dc95b4cf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:17.628639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-197051f4-7239-4a05-a8e4-52d5dc95b4cf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:17.629068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-197051f4-7239-4a05-a8e4-52d5dc95b4cf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:17.790865 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a84fccdc-518e-4d72-b8e7-7d20c7fa51bb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:17.791489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a84fccdc-518e-4d72-b8e7-7d20c7fa51bb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:17.797483 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84fccdc-518e-4d72-b8e7-7d20c7fa51bb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:17.797974 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84fccdc-518e-4d72-b8e7-7d20c7fa51bb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:17.798409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84fccdc-518e-4d72-b8e7-7d20c7fa51bb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:17.799105 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84fccdc-518e-4d72-b8e7-7d20c7fa51bb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:17.800050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84fccdc-518e-4d72-b8e7-7d20c7fa51bb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:17.800501 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84fccdc-518e-4d72-b8e7-7d20c7fa51bb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:17.802389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-197051f4-7239-4a05-a8e4-52d5dc95b4cf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:17.809832 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-197051f4-7239-4a05-a8e4-52d5dc95b4cf tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.202686 Aug 10 16:59:17.810476 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 329/649] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:17 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:17.824998 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-a84fccdc-518e-4d72-b8e7-7d20c7fa51bb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lazy-loading 'flavor' on Instance uuid 9c45104f-0ee5-4fec-92ad-7937cbe53805 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:59:18.832048 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-47ad8fb5-6a54-4c91-b48a-7df1c2a6c4ee tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:18.832695 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-47ad8fb5-6a54-4c91-b48a-7df1c2a6c4ee tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:18.839374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47ad8fb5-6a54-4c91-b48a-7df1c2a6c4ee tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:18.839831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47ad8fb5-6a54-4c91-b48a-7df1c2a6c4ee tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:18.840423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47ad8fb5-6a54-4c91-b48a-7df1c2a6c4ee tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:18.841134 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47ad8fb5-6a54-4c91-b48a-7df1c2a6c4ee tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:18.841569 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47ad8fb5-6a54-4c91-b48a-7df1c2a6c4ee tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:18.842175 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47ad8fb5-6a54-4c91-b48a-7df1c2a6c4ee tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:18.974639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-47ad8fb5-6a54-4c91-b48a-7df1c2a6c4ee tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:18.983723 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-47ad8fb5-6a54-4c91-b48a-7df1c2a6c4ee tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1319 microversion: 2.1 time: 0.155186 Aug 10 16:59:18.984706 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 330/650] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:18 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:19.561418 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bd1a38b6-5dc7-42f0-b202-16df888c3eec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb2a23ae-927d-4e24-bc6d-dcbd254e25de"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:19.564332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bd1a38b6-5dc7-42f0-b202-16df888c3eec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:19.571480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd1a38b6-5dc7-42f0-b202-16df888c3eec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:19.571959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd1a38b6-5dc7-42f0-b202-16df888c3eec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:19.572463 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd1a38b6-5dc7-42f0-b202-16df888c3eec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:19.573286 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd1a38b6-5dc7-42f0-b202-16df888c3eec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:19.573733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd1a38b6-5dc7-42f0-b202-16df888c3eec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:19.574258 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd1a38b6-5dc7-42f0-b202-16df888c3eec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:20.785406 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bd1a38b6-5dc7-42f0-b202-16df888c3eec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.228677 Aug 10 16:59:20.792529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 331/651] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 16:59:19 2022] POST /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-volume_attachments => generated 194 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:59:20.798135 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e8134d30-0e63-47b1-80b2-9208ac63a438 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:20.799946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e8134d30-0e63-47b1-80b2-9208ac63a438 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:20.807702 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8134d30-0e63-47b1-80b2-9208ac63a438 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:20.808588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8134d30-0e63-47b1-80b2-9208ac63a438 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:20.809197 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8134d30-0e63-47b1-80b2-9208ac63a438 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:20.810083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8134d30-0e63-47b1-80b2-9208ac63a438 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:20.810698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8134d30-0e63-47b1-80b2-9208ac63a438 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:20.811311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8134d30-0e63-47b1-80b2-9208ac63a438 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:20.837066 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:20.994154 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e8134d30-0e63-47b1-80b2-9208ac63a438 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:21.004648 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e8134d30-0e63-47b1-80b2-9208ac63a438 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1507 microversion: 2.1 time: 0.210572 Aug 10 16:59:21.005147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 332/652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:20 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:21.025808 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fa4160fb-4985-4af7-b01b-0dd36f02084a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b98b930-ca30-47e5-9c10-27895dc07184", "device": "/dev/sdb"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:21.028826 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fa4160fb-4985-4af7-b01b-0dd36f02084a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:21.035469 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4160fb-4985-4af7-b01b-0dd36f02084a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:21.036000 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4160fb-4985-4af7-b01b-0dd36f02084a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:21.036599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4160fb-4985-4af7-b01b-0dd36f02084a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:21.037469 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4160fb-4985-4af7-b01b-0dd36f02084a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:21.038138 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4160fb-4985-4af7-b01b-0dd36f02084a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:21.039341 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4160fb-4985-4af7-b01b-0dd36f02084a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:21.354365 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fa4160fb-4985-4af7-b01b-0dd36f02084a tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "POST /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332569 Aug 10 16:59:21.355022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 333/653] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 16:59:21 2022] POST /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:59:21.639756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cb99357b-e924-4336-acb7-9d4a1418bc0d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:21.640556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cb99357b-e924-4336-acb7-9d4a1418bc0d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:21.647077 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb99357b-e924-4336-acb7-9d4a1418bc0d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:21.647553 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb99357b-e924-4336-acb7-9d4a1418bc0d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:21.647984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb99357b-e924-4336-acb7-9d4a1418bc0d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:21.648782 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb99357b-e924-4336-acb7-9d4a1418bc0d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:21.649322 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb99357b-e924-4336-acb7-9d4a1418bc0d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:21.649780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb99357b-e924-4336-acb7-9d4a1418bc0d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:21.673492 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cb99357b-e924-4336-acb7-9d4a1418bc0d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/ips" status: 200 len: 147 microversion: 2.1 time: 0.037989 Aug 10 16:59:21.674208 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 334/654] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 10 16:59:21 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:59:23.196261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a84fccdc-518e-4d72-b8e7-7d20c7fa51bb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "POST /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/action" status: 202 len: 0 microversion: 2.20 time: 5.409937 Aug 10 16:59:23.197152 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 321/655] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Aug 10 16:59:17 2022] POST /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/action => generated 0 bytes in 5412 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 16:59:23.213708 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:23.215006 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:23.221932 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:23.222416 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:23.222845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:23.223533 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:23.224251 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:23.224737 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:23.382320 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:23.390391 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:23.392098 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:23.393994 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-295e9b2f-a74a-46a4-909d-ed7520e8679c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.185561 Aug 10 16:59:23.395179 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 335/656] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:23 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:59:24.418976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:24.419702 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:24.425850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:24.426329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:24.426760 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:24.427451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:24.427898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:24.428352 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:24.562299 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:24.570970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:24.572516 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:24.573676 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-37fa7770-b86e-4bf3-8c50-d7a068f3e7ee tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.159617 Aug 10 16:59:24.574224 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 322/657] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:24 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:25.597032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:25.598444 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:25.616993 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:25.618312 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:25.618847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:25.619667 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:25.620129 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:25.620581 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:25.763088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:25.771607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:25.773169 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:25.774335 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6dd0ea2b-36f3-493d-9c18-3b1a395e2363 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.181719 Aug 10 16:59:25.774878 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 336/658] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:25 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:26.447336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b614c157-1fd0-4dbe-8b96-71392d1521ee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "199101e4-ff45-4c96-9d0d-3ea8904fb305"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:26.449639 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b614c157-1fd0-4dbe-8b96-71392d1521ee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:26.464878 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b614c157-1fd0-4dbe-8b96-71392d1521ee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:26.465378 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b614c157-1fd0-4dbe-8b96-71392d1521ee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:26.465815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b614c157-1fd0-4dbe-8b96-71392d1521ee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:26.466700 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b614c157-1fd0-4dbe-8b96-71392d1521ee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:26.467158 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b614c157-1fd0-4dbe-8b96-71392d1521ee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:26.467585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b614c157-1fd0-4dbe-8b96-71392d1521ee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:26.799865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:26.801260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:26.809973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:26.810839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:26.811453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:26.812381 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:26.812864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:26.813287 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:26.869027 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b614c157-1fd0-4dbe-8b96-71392d1521ee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "POST /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425455 Aug 10 16:59:26.871649 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 323/659] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 16:59:26 2022] POST /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:59:26.965735 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:26.974975 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:26.976764 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:26.978064 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3062c837-e23e-45eb-9947-f43edec56eba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.183840 Aug 10 16:59:26.978854 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 337/660] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:26 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:59:28.004009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:28.005278 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:28.018198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:28.018198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:28.018198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:28.018198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:28.018520 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:28.018520 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:28.159474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:28.167949 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:28.169488 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:28.170856 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19c36f06-f4f0-4f4f-8205-c39b44a6bbbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.171983 Aug 10 16:59:28.172251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 324/661] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:27 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:29.194876 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:29.195479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:29.201489 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:29.201965 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:29.202389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:29.203102 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:29.203546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:29.203993 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:29.338811 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:29.347691 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:29.349274 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:29.350744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-44d28a9b-c37b-45a7-ac09-09f89c1c31f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.159694 Aug 10 16:59:29.364200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 338/662] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:29 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:29.517101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5307e0c4-6a49-4140-8841-4cdaa87e4571 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: .version_select at 0x7f5b082f63a0>, body: {"keypair": {"name": "tempest-keypair-1857236865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrqb0dXCP5F2jRbXX5Cx6n/A7E4sh+U4aPV9TTNdO4f1cTgvHyc/QfarNg3JfgD3NMnylUBXPJGviDpUVE7xZjd4+28/7CX1M7A5Lt6jelvoT1IK43wo2R5QiRs0RywUQ=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:29.533526 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-5307e0c4-6a49-4140-8841-4cdaa87e4571 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:59:29.537205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-5307e0c4-6a49-4140-8841-4cdaa87e4571 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for user 7a701149974b45db9f782bc5a232aabe and project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:59:29.558273 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5307e0c4-6a49-4140-8841-4cdaa87e4571 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044964 Aug 10 16:59:29.558847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 325/663] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 10 16:59:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:59:30.374565 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:30.375894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:30.383975 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:30.384880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:30.385899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:30.386873 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:30.387582 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:30.388332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:30.615262 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:30.625383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:30.628063 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:30.629670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-73604020-c211-4052-8029-3be20f8d8ace tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.259303 Aug 10 16:59:30.645252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 339/664] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:30 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:31.510345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-800978083", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbfebec6-8639-47f9-80f8-59f6b2be1e54"}], "security_groups": [{"name": "tempest-securitygroup--1118460239"}], "key_name": "tempest-keypair-1857236865", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:31.623506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] validate_networks() for [('dbfebec6-8639-47f9-80f8-59f6b2be1e54', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:59:31.654234 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:31.655488 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:31.662266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:31.663161 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:31.663853 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:31.664805 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:31.665329 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:31.665821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:31.820990 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:31.843552 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:31.845148 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:31.846826 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fe81f3a9-56fb-4717-a28b-1014c5bd2888 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.196424 Aug 10 16:59:31.847588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 340/665] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:31 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:59:32.067464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:59:32.068084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:59:32.068831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:59:32.069528 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:59:32.070224 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:59:32.084609 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:32.085258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:32.085803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:32.086638 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:32.087158 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:32.087728 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:32.127719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:59:32.136068 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for user 7a701149974b45db9f782bc5a232aabe and project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:59:32.151022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:59:32.152283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:59:32.225103 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14d08057-bf57-42ad-ac29-99863789cacf tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.719648 Aug 10 16:59:32.226018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 326/666] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:59:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 16:59:32.238989 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-04388ebf-0614-4424-9736-51a3bfa0e5d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:32.239735 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-04388ebf-0614-4424-9736-51a3bfa0e5d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:32.336530 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-04388ebf-0614-4424-9736-51a3bfa0e5d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:32.344904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-04388ebf-0614-4424-9736-51a3bfa0e5d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1241 microversion: 2.1 time: 0.111336 Aug 10 16:59:32.346602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 341/667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:32 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:32.875299 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:32.875906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:32.884370 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:32.885447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:32.886053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:32.887088 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:32.887696 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:32.888327 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:33.026015 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:33.036041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:33.038115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:33.040319 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e1453f83-a1c1-4132-93ec-11906daaad8d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.169623 Aug 10 16:59:33.041781 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 327/668] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:32 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:33.366995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a2536554-b419-4335-a61d-c0999d6c79fb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:33.367629 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a2536554-b419-4335-a61d-c0999d6c79fb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:33.375096 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2536554-b419-4335-a61d-c0999d6c79fb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:33.375688 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2536554-b419-4335-a61d-c0999d6c79fb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:33.376125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2536554-b419-4335-a61d-c0999d6c79fb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:33.376882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2536554-b419-4335-a61d-c0999d6c79fb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:33.378162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2536554-b419-4335-a61d-c0999d6c79fb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:33.378591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2536554-b419-4335-a61d-c0999d6c79fb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:33.450001 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a2536554-b419-4335-a61d-c0999d6c79fb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:33.462498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a2536554-b419-4335-a61d-c0999d6c79fb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1293 microversion: 2.1 time: 0.095154 Aug 10 16:59:33.463562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 342/669] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:33 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:34.063694 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:34.068670 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:34.113967 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:34.130188 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:34.134865 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:34.135432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:34.136399 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:34.136967 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:34.137496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:34.429140 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:34.441111 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:34.443082 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:34.444586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63820767-94a8-4d1a-861d-90c5b1bd0594 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.384910 Aug 10 16:59:34.445691 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 328/670] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:34 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:34.483666 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-42db42ff-8e60-4394-bd8f-4e554cdb1fbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:34.484326 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-42db42ff-8e60-4394-bd8f-4e554cdb1fbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:34.491526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42db42ff-8e60-4394-bd8f-4e554cdb1fbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:34.492025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42db42ff-8e60-4394-bd8f-4e554cdb1fbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:34.492494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42db42ff-8e60-4394-bd8f-4e554cdb1fbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:34.493194 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42db42ff-8e60-4394-bd8f-4e554cdb1fbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:34.493823 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42db42ff-8e60-4394-bd8f-4e554cdb1fbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:34.494406 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42db42ff-8e60-4394-bd8f-4e554cdb1fbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:34.568180 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-42db42ff-8e60-4394-bd8f-4e554cdb1fbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:34.578716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-42db42ff-8e60-4394-bd8f-4e554cdb1fbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1299 microversion: 2.1 time: 0.099557 Aug 10 16:59:34.589448 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 343/671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:34 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:35.472390 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:35.472967 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:35.479527 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:35.480013 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:35.480468 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:35.481211 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:35.481664 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:35.482086 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:35.600225 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fb01a4af-f6c2-4cf8-b2e5-436279dd1036 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:35.601613 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fb01a4af-f6c2-4cf8-b2e5-436279dd1036 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:35.608824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb01a4af-f6c2-4cf8-b2e5-436279dd1036 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:35.609560 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb01a4af-f6c2-4cf8-b2e5-436279dd1036 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:35.609993 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb01a4af-f6c2-4cf8-b2e5-436279dd1036 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:35.610683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb01a4af-f6c2-4cf8-b2e5-436279dd1036 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:35.611933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb01a4af-f6c2-4cf8-b2e5-436279dd1036 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:35.612387 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb01a4af-f6c2-4cf8-b2e5-436279dd1036 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:35.696708 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:35.705377 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:35.707011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:35.708177 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2b4a963d-b958-4e3e-9f8c-e0bdbb889598 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.239656 Aug 10 16:59:35.708989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 329/672] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:35 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:35.713188 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-79d8f2b6-4526-4a6a-b60f-1538a2ec2253 req-72f23674-ed56-463f-87a9-1b35524620b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ed24c9-1f9e-48fa-94f0-773f2963e5b9", "tag": "e32f7fef-5326-4138-b204-5b508dd1425c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:35.722322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-79d8f2b6-4526-4a6a-b60f-1538a2ec2253 req-72f23674-ed56-463f-87a9-1b35524620b1 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:35.722797 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-79d8f2b6-4526-4a6a-b60f-1538a2ec2253 req-72f23674-ed56-463f-87a9-1b35524620b1 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:35.723225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-79d8f2b6-4526-4a6a-b60f-1538a2ec2253 req-72f23674-ed56-463f-87a9-1b35524620b1 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:35.733883 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-79d8f2b6-4526-4a6a-b60f-1538a2ec2253 req-72f23674-ed56-463f-87a9-1b35524620b1 service nova] Creating event network-changed:e32f7fef-5326-4138-b204-5b508dd1425c for instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 on hv-cinder-83602 Aug 10 16:59:35.739218 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-79d8f2b6-4526-4a6a-b60f-1538a2ec2253 req-72f23674-ed56-463f-87a9-1b35524620b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029155 Aug 10 16:59:35.740099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 330/673] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 16:59:35.764368 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fb01a4af-f6c2-4cf8-b2e5-436279dd1036 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:35.771855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fb01a4af-f6c2-4cf8-b2e5-436279dd1036 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.175386 Aug 10 16:59:35.772453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 344/674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:35 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:59:36.732410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:36.733103 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:36.739889 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:36.748844 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:36.749513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:36.750295 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:36.750681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:36.751092 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:36.754476 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:36.799559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bc3ffbc8-0e93-486e-82f3-4ee50e606f2b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:36.800033 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bc3ffbc8-0e93-486e-82f3-4ee50e606f2b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:36.809509 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc3ffbc8-0e93-486e-82f3-4ee50e606f2b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:36.810005 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc3ffbc8-0e93-486e-82f3-4ee50e606f2b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:36.810442 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc3ffbc8-0e93-486e-82f3-4ee50e606f2b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:36.811144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc3ffbc8-0e93-486e-82f3-4ee50e606f2b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:36.811683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc3ffbc8-0e93-486e-82f3-4ee50e606f2b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:36.812111 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc3ffbc8-0e93-486e-82f3-4ee50e606f2b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:36.977469 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bc3ffbc8-0e93-486e-82f3-4ee50e606f2b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:36.985882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bc3ffbc8-0e93-486e-82f3-4ee50e606f2b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.190104 Aug 10 16:59:37.000268 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 345/675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:36 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:37.031012 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:37.039751 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:37.041456 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:37.042788 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-630bb60f-bc9a-4471-a6a5-e56df65545c3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.315631 Aug 10 16:59:37.043645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 331/676] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:36 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:38.006849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-45e84b84-898a-409f-abfd-b6279f2a34cb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:38.007488 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-45e84b84-898a-409f-abfd-b6279f2a34cb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:38.013844 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45e84b84-898a-409f-abfd-b6279f2a34cb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:38.014329 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45e84b84-898a-409f-abfd-b6279f2a34cb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:38.014772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45e84b84-898a-409f-abfd-b6279f2a34cb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:38.015459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45e84b84-898a-409f-abfd-b6279f2a34cb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:38.015913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45e84b84-898a-409f-abfd-b6279f2a34cb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:38.016374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45e84b84-898a-409f-abfd-b6279f2a34cb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:38.066704 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:38.067306 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:38.073643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:38.074121 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:38.074549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:38.075236 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:38.075683 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:38.076102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:38.152672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-45e84b84-898a-409f-abfd-b6279f2a34cb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:38.160296 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-45e84b84-898a-409f-abfd-b6279f2a34cb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.157300 Aug 10 16:59:38.161076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 346/677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:38 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:38.292668 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:38.300513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:38.302008 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:38.303149 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-980ba749-2f4d-4f39-9fed-88bb5b44fe38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.241650 Aug 10 16:59:38.303702 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 332/678] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:38 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:39.181233 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2d118163-263a-40f8-bd77-9df32603a737 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:39.181828 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2d118163-263a-40f8-bd77-9df32603a737 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:39.188338 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d118163-263a-40f8-bd77-9df32603a737 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:39.188820 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d118163-263a-40f8-bd77-9df32603a737 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:39.189250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d118163-263a-40f8-bd77-9df32603a737 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:39.189935 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d118163-263a-40f8-bd77-9df32603a737 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:39.190382 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d118163-263a-40f8-bd77-9df32603a737 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:39.190798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d118163-263a-40f8-bd77-9df32603a737 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:39.326993 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:39.327517 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:39.335001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:39.335391 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:39.336009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:39.336912 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:39.337522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:39.338102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:39.338226 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2d118163-263a-40f8-bd77-9df32603a737 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:39.347722 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2d118163-263a-40f8-bd77-9df32603a737 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.170464 Aug 10 16:59:39.348317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 347/679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:39 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:39.485079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:39.492846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:39.494415 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:39.495555 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ebddcfdf-ad52-4373-a341-0333d76df2dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.172764 Aug 10 16:59:39.496108 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 333/680] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:39 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:40.373033 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-11a3263c-4e0f-4021-8e57-1cd2170ffc8f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:40.373930 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-11a3263c-4e0f-4021-8e57-1cd2170ffc8f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:40.377514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=50 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:40.385144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11a3263c-4e0f-4021-8e57-1cd2170ffc8f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:40.385927 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11a3263c-4e0f-4021-8e57-1cd2170ffc8f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:40.386697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11a3263c-4e0f-4021-8e57-1cd2170ffc8f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:40.387871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11a3263c-4e0f-4021-8e57-1cd2170ffc8f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:40.388697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11a3263c-4e0f-4021-8e57-1cd2170ffc8f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:40.389374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11a3263c-4e0f-4021-8e57-1cd2170ffc8f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:40.525857 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:40.527082 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:40.536439 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-11a3263c-4e0f-4021-8e57-1cd2170ffc8f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:40.536827 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:40.537318 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:40.537804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:40.539040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:40.539854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:40.540317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:40.552384 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-11a3263c-4e0f-4021-8e57-1cd2170ffc8f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.185729 Aug 10 16:59:40.553318 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 348/681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:40 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:40.685566 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:40.693777 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:40.695302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:40.696446 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-58f8f555-727c-41ad-ac47-699952dae31c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.181834 Aug 10 16:59:40.697141 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 334/682] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:40 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:59:41.573874 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-65a636ce-ddd6-4067-906d-65ad48181a5a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:41.574481 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-65a636ce-ddd6-4067-906d-65ad48181a5a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:41.580791 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65a636ce-ddd6-4067-906d-65ad48181a5a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:41.581266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65a636ce-ddd6-4067-906d-65ad48181a5a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:41.581690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65a636ce-ddd6-4067-906d-65ad48181a5a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:41.582371 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65a636ce-ddd6-4067-906d-65ad48181a5a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:41.582832 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65a636ce-ddd6-4067-906d-65ad48181a5a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:41.583236 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65a636ce-ddd6-4067-906d-65ad48181a5a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:41.587337 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:41.713974 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-65a636ce-ddd6-4067-906d-65ad48181a5a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:41.719426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:41.720039 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:41.726327 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:41.726831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:41.727254 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:41.727986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:41.728471 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:41.728914 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:41.731941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-65a636ce-ddd6-4067-906d-65ad48181a5a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.161739 Aug 10 16:59:41.744523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 349/683] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:41 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:41.857386 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:41.865871 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:41.867374 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:41.868568 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-61c8c340-7fe9-4f65-9bfd-64ccd8d2382a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.152903 Aug 10 16:59:41.869116 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 335/684] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:41 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:59:42.754895 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-969ef352-40f1-4673-a8f9-aeb959c037ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:42.755509 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-969ef352-40f1-4673-a8f9-aeb959c037ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:42.757351 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:42.763205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef352-40f1-4673-a8f9-aeb959c037ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:42.763695 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef352-40f1-4673-a8f9-aeb959c037ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:42.764135 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef352-40f1-4673-a8f9-aeb959c037ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:42.764849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef352-40f1-4673-a8f9-aeb959c037ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:42.765300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef352-40f1-4673-a8f9-aeb959c037ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:42.765723 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef352-40f1-4673-a8f9-aeb959c037ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:42.891708 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:42.892854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:42.894847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:42.895936 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=10 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:42.898451 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-969ef352-40f1-4673-a8f9-aeb959c037ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:42.902463 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:42.902957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:42.903424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:42.904128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:42.904610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:42.905041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:42.905890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-969ef352-40f1-4673-a8f9-aeb959c037ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.155574 Aug 10 16:59:42.906447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 350/685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:42 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:43.031432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:43.039292 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:43.040836 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:43.041949 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ddc4585d-c3e9-4b03-b39f-04776b77df2e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.154313 Aug 10 16:59:43.042504 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 336/686] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:42 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:59:43.926634 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1f849956-5987-4f13-8c4d-29663b4bc4f5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:43.927224 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1f849956-5987-4f13-8c4d-29663b4bc4f5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:43.939517 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f849956-5987-4f13-8c4d-29663b4bc4f5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:43.940000 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f849956-5987-4f13-8c4d-29663b4bc4f5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:43.940509 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f849956-5987-4f13-8c4d-29663b4bc4f5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:43.941247 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f849956-5987-4f13-8c4d-29663b4bc4f5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:43.941875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f849956-5987-4f13-8c4d-29663b4bc4f5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:43.942119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f849956-5987-4f13-8c4d-29663b4bc4f5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:44.065547 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:44.066160 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:44.073266 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:44.073761 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:44.074325 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:44.075038 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:44.075171 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1f849956-5987-4f13-8c4d-29663b4bc4f5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:44.075803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:44.076409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:44.084329 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1f849956-5987-4f13-8c4d-29663b4bc4f5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.161589 Aug 10 16:59:44.085008 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 351/687] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:43 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:44.209520 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:44.219565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:44.221622 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:44.228792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f0b45f8e-ab65-439d-81ef-73a06fb06050 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.168555 Aug 10 16:59:44.229303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 337/688] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:44 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:59:45.105021 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6c73677d-df44-4fdd-82ae-82d4db19d306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:45.105630 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6c73677d-df44-4fdd-82ae-82d4db19d306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:45.112990 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c73677d-df44-4fdd-82ae-82d4db19d306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:45.113480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c73677d-df44-4fdd-82ae-82d4db19d306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:45.113907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c73677d-df44-4fdd-82ae-82d4db19d306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:45.114590 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c73677d-df44-4fdd-82ae-82d4db19d306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:45.115035 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c73677d-df44-4fdd-82ae-82d4db19d306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:45.115455 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c73677d-df44-4fdd-82ae-82d4db19d306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:45.251051 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:45.251681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:45.258127 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:45.258619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:45.259057 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:45.259751 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:45.260287 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:45.260744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:45.448396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6c73677d-df44-4fdd-82ae-82d4db19d306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:45.456558 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6c73677d-df44-4fdd-82ae-82d4db19d306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.355361 Aug 10 16:59:45.457202 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 352/689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:45 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:45.469604 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:45.479692 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:45.481222 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:45.482421 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7e804d7b-c3e8-4b28-b862-1791fc34934d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.235538 Aug 10 16:59:45.482973 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 338/690] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:45 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:45.973837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1567420293", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-465937417", "security_groups": [{"name": "tempest-secgroup-smoke-1125656476"}], "block_device_mapping_v2": [{"uuid": "574feaff-45fd-4867-9af6-ab8bd1fb91f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f5066015-605a-4fe4-890b-df73669544bb"}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:46.086982 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] validate_networks() for [('f5066015-605a-4fe4-890b-df73669544bb', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 16:59:46.471330 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 16:59:46.471820 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 16:59:46.472275 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 16:59:46.472683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 16:59:46.473128 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 16:59:46.477282 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3a50438-aa12-409f-a383-df84b0d7b9ec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:46.477899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c3a50438-aa12-409f-a383-df84b0d7b9ec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:46.482125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:46.482614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:46.483051 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:46.483780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:46.484256 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:46.484446 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3a50438-aa12-409f-a383-df84b0d7b9ec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:46.484691 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:46.484940 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3a50438-aa12-409f-a383-df84b0d7b9ec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:46.485416 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3a50438-aa12-409f-a383-df84b0d7b9ec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:46.486689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3a50438-aa12-409f-a383-df84b0d7b9ec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:46.487147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3a50438-aa12-409f-a383-df84b0d7b9ec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:46.487578 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3a50438-aa12-409f-a383-df84b0d7b9ec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:46.502093 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Getting quotas for project 41311d9aa3f54596a61033b0ea82ba80. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 16:59:46.506147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Getting quotas for user a1c78f05a0f24151a1884faed65d286e and project 41311d9aa3f54596a61033b0ea82ba80. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 16:59:46.570462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 16:59:46.572628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='574feaff-45fd-4867-9af6-ab8bd1fb91f0',volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 16:59:46.625338 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c3a50438-aa12-409f-a383-df84b0d7b9ec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:46.633150 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3a50438-aa12-409f-a383-df84b0d7b9ec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.159671 Aug 10 16:59:46.633721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 339/691] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:46 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:59:46.638117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:46.638895 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:46.651281 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:46.651896 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:46.652499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:46.653324 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:46.653858 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:46.654358 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:46.708904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d233c188-2119-4a30-8c5e-25ead1753848 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.738505 Aug 10 16:59:46.709552 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 353/692] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 16:59:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 16:59:46.721953 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a09b9730-a437-4259-99ee-b2b508d05f02 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:46.722826 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a09b9730-a437-4259-99ee-b2b508d05f02 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:46.785958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a09b9730-a437-4259-99ee-b2b508d05f02 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:46.793788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a09b9730-a437-4259-99ee-b2b508d05f02 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1094 microversion: 2.1 time: 0.077523 Aug 10 16:59:46.796591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 354/693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:46 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:46.804715 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:46.814143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:46.815674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:46.816855 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8cba6086-5260-4ebe-9299-03b32481db2c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.182194 Aug 10 16:59:46.817394 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 340/694] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:46 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:47.654290 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9e536a16-d7fc-4b9a-9a42-fcd5d66ebc65 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:47.654880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9e536a16-d7fc-4b9a-9a42-fcd5d66ebc65 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:47.661111 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e536a16-d7fc-4b9a-9a42-fcd5d66ebc65 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:47.661617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e536a16-d7fc-4b9a-9a42-fcd5d66ebc65 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:47.662043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e536a16-d7fc-4b9a-9a42-fcd5d66ebc65 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:47.662721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e536a16-d7fc-4b9a-9a42-fcd5d66ebc65 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:47.663161 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e536a16-d7fc-4b9a-9a42-fcd5d66ebc65 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:47.663575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e536a16-d7fc-4b9a-9a42-fcd5d66ebc65 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:47.794315 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9e536a16-d7fc-4b9a-9a42-fcd5d66ebc65 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:47.802598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9e536a16-d7fc-4b9a-9a42-fcd5d66ebc65 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.152106 Aug 10 16:59:47.803208 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 355/695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:47 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:47.813832 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9aba7ff0-89fd-4113-8a22-3976d5338368 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:47.815072 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9aba7ff0-89fd-4113-8a22-3976d5338368 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:47.821443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aba7ff0-89fd-4113-8a22-3976d5338368 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:47.821931 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aba7ff0-89fd-4113-8a22-3976d5338368 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:47.822371 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aba7ff0-89fd-4113-8a22-3976d5338368 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:47.823059 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aba7ff0-89fd-4113-8a22-3976d5338368 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:47.823512 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aba7ff0-89fd-4113-8a22-3976d5338368 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:47.823932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aba7ff0-89fd-4113-8a22-3976d5338368 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:47.839014 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:47.839866 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:47.848077 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:47.848692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:47.849266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:47.850306 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:47.850870 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:47.851355 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:47.886980 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9aba7ff0-89fd-4113-8a22-3976d5338368 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:47.894408 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9aba7ff0-89fd-4113-8a22-3976d5338368 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1144 microversion: 2.1 time: 0.084319 Aug 10 16:59:47.895184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 341/696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:47 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:47.993943 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:48.001775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:48.003239 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:48.004395 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3e864221-61c2-4a99-8699-3d8b433564fd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.169247 Aug 10 16:59:48.004950 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 356/697] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:47 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:59:48.823499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b398efa-e5c9-4b17-a105-0269207f94e1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:48.824112 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6b398efa-e5c9-4b17-a105-0269207f94e1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:48.830429 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b398efa-e5c9-4b17-a105-0269207f94e1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:48.830914 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b398efa-e5c9-4b17-a105-0269207f94e1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:48.831937 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b398efa-e5c9-4b17-a105-0269207f94e1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:48.832656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b398efa-e5c9-4b17-a105-0269207f94e1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:48.833112 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b398efa-e5c9-4b17-a105-0269207f94e1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:48.833807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b398efa-e5c9-4b17-a105-0269207f94e1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:48.914485 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bb4cc83f-4df7-4244-ba6a-9b51197eae9e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:48.915139 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bb4cc83f-4df7-4244-ba6a-9b51197eae9e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:48.921473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb4cc83f-4df7-4244-ba6a-9b51197eae9e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:48.921957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb4cc83f-4df7-4244-ba6a-9b51197eae9e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:48.922388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb4cc83f-4df7-4244-ba6a-9b51197eae9e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:48.923143 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb4cc83f-4df7-4244-ba6a-9b51197eae9e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:48.923596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb4cc83f-4df7-4244-ba6a-9b51197eae9e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:48.924016 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb4cc83f-4df7-4244-ba6a-9b51197eae9e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:48.970297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6b398efa-e5c9-4b17-a105-0269207f94e1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:48.978202 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b398efa-e5c9-4b17-a105-0269207f94e1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.158535 Aug 10 16:59:48.978899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 342/698] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:48 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:48.987896 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bb4cc83f-4df7-4244-ba6a-9b51197eae9e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:48.995414 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bb4cc83f-4df7-4244-ba6a-9b51197eae9e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1144 microversion: 2.1 time: 0.084766 Aug 10 16:59:48.996058 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 357/699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:48 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:59:49.027628 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:49.028280 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:49.034782 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:49.035279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:49.035723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:49.036494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:49.037010 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:49.037439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:49.168522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:49.176974 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:49.178468 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:49.179607 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-347089da-c98e-49f0-af1b-8991246b116a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.156723 Aug 10 16:59:49.180158 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 343/700] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:49 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:49.998808 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8e92ac56-5abd-492b-ac60-7eb395394df6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:49.999336 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8e92ac56-5abd-492b-ac60-7eb395394df6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:50.005321 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e92ac56-5abd-492b-ac60-7eb395394df6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:50.005796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e92ac56-5abd-492b-ac60-7eb395394df6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:50.006220 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e92ac56-5abd-492b-ac60-7eb395394df6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:50.006898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e92ac56-5abd-492b-ac60-7eb395394df6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:50.007342 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e92ac56-5abd-492b-ac60-7eb395394df6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:50.007773 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e92ac56-5abd-492b-ac60-7eb395394df6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:50.016297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7f969c8a-4d9c-420f-93c4-df51bca1fcaf tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:50.016918 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7f969c8a-4d9c-420f-93c4-df51bca1fcaf tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:50.024221 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f969c8a-4d9c-420f-93c4-df51bca1fcaf tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:50.024843 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f969c8a-4d9c-420f-93c4-df51bca1fcaf tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:50.025276 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f969c8a-4d9c-420f-93c4-df51bca1fcaf tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:50.025985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f969c8a-4d9c-420f-93c4-df51bca1fcaf tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:50.026444 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f969c8a-4d9c-420f-93c4-df51bca1fcaf tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:50.026869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f969c8a-4d9c-420f-93c4-df51bca1fcaf tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:50.092386 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7f969c8a-4d9c-420f-93c4-df51bca1fcaf tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:50.099725 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7f969c8a-4d9c-420f-93c4-df51bca1fcaf tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1144 microversion: 2.1 time: 0.087216 Aug 10 16:59:50.100321 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 344/701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:50 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:59:50.138149 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8e92ac56-5abd-492b-ac60-7eb395394df6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:50.146424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8e92ac56-5abd-492b-ac60-7eb395394df6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.151483 Aug 10 16:59:50.146981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 358/702] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:49 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:50.202776 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:50.203384 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:50.210241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:50.210724 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:50.211158 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:50.211848 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:50.212332 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:50.212761 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:50.344534 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:50.352305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:50.353793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:50.354938 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9d5e76b8-8942-4924-8334-fa2681ea4ebc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.156029 Aug 10 16:59:50.355494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 345/703] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:50 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:51.120443 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6f5afd94-a108-4829-aa23-c1f8aa5c3db6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:51.120931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6f5afd94-a108-4829-aa23-c1f8aa5c3db6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:51.127166 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f5afd94-a108-4829-aa23-c1f8aa5c3db6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:51.127642 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f5afd94-a108-4829-aa23-c1f8aa5c3db6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:51.128582 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f5afd94-a108-4829-aa23-c1f8aa5c3db6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:51.129257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f5afd94-a108-4829-aa23-c1f8aa5c3db6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:51.129700 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f5afd94-a108-4829-aa23-c1f8aa5c3db6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:51.130116 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f5afd94-a108-4829-aa23-c1f8aa5c3db6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:51.167021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d6f973e0-4caf-4273-a583-459a2efd7277 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:51.167654 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d6f973e0-4caf-4273-a583-459a2efd7277 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:51.175175 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6f973e0-4caf-4273-a583-459a2efd7277 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:51.175668 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6f973e0-4caf-4273-a583-459a2efd7277 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:51.176103 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6f973e0-4caf-4273-a583-459a2efd7277 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:51.176831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6f973e0-4caf-4273-a583-459a2efd7277 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:51.177283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6f973e0-4caf-4273-a583-459a2efd7277 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:51.177771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6f973e0-4caf-4273-a583-459a2efd7277 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:51.192866 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6f5afd94-a108-4829-aa23-c1f8aa5c3db6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:51.200219 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6f5afd94-a108-4829-aa23-c1f8aa5c3db6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1144 microversion: 2.1 time: 0.083872 Aug 10 16:59:51.200922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 359/704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:51 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:51.304380 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d6f973e0-4caf-4273-a583-459a2efd7277 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:51.311868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d6f973e0-4caf-4273-a583-459a2efd7277 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.148606 Aug 10 16:59:51.312746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 346/705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:51 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 16:59:51.377322 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:51.378476 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:51.384821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:51.385301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:51.386099 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:51.387023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:51.387490 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:51.388042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:51.521433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:51.529199 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:51.530693 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:51.531817 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ec735c2a-7107-435e-8136-2c64035850f0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.158477 Aug 10 16:59:51.532392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 360/706] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:51 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:52.221570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da72fab1-a11f-4089-acf9-4f74c5818d96 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:52.222180 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da72fab1-a11f-4089-acf9-4f74c5818d96 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:52.229467 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da72fab1-a11f-4089-acf9-4f74c5818d96 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:52.229946 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da72fab1-a11f-4089-acf9-4f74c5818d96 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:52.230374 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da72fab1-a11f-4089-acf9-4f74c5818d96 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:52.231064 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da72fab1-a11f-4089-acf9-4f74c5818d96 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:52.231513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da72fab1-a11f-4089-acf9-4f74c5818d96 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:52.231930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da72fab1-a11f-4089-acf9-4f74c5818d96 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:52.290858 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-da72fab1-a11f-4089-acf9-4f74c5818d96 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:52.293070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:52.299310 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da72fab1-a11f-4089-acf9-4f74c5818d96 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1144 microversion: 2.1 time: 0.081747 Aug 10 16:59:52.299873 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 347/707] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:52 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:52.335490 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-43eba7fa-e401-4605-927d-b0b432a431d2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:52.336271 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-43eba7fa-e401-4605-927d-b0b432a431d2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:52.342542 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43eba7fa-e401-4605-927d-b0b432a431d2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:52.343021 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43eba7fa-e401-4605-927d-b0b432a431d2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:52.343452 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43eba7fa-e401-4605-927d-b0b432a431d2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:52.344136 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43eba7fa-e401-4605-927d-b0b432a431d2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:52.344610 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43eba7fa-e401-4605-927d-b0b432a431d2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:52.345032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-43eba7fa-e401-4605-927d-b0b432a431d2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:52.475250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-43eba7fa-e401-4605-927d-b0b432a431d2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:52.483182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-43eba7fa-e401-4605-927d-b0b432a431d2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.152400 Aug 10 16:59:52.483742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 361/708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:52 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:52.555596 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:52.556225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:52.562180 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:52.562696 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:52.563136 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:52.563962 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:52.564368 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:52.564823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:52.699706 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:52.707565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:52.709362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:52.710511 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0ecee53a-edc1-40ad-af9c-d0a5a73aa6af tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.159045 Aug 10 16:59:52.711077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 348/709] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:52 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:53.319439 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d57ed324-39fe-4a30-90d5-36bd94ef1825 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:53.320083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d57ed324-39fe-4a30-90d5-36bd94ef1825 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:53.326102 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d57ed324-39fe-4a30-90d5-36bd94ef1825 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:53.326514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d57ed324-39fe-4a30-90d5-36bd94ef1825 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:53.326937 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d57ed324-39fe-4a30-90d5-36bd94ef1825 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:53.327608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d57ed324-39fe-4a30-90d5-36bd94ef1825 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:53.328050 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d57ed324-39fe-4a30-90d5-36bd94ef1825 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:53.328584 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d57ed324-39fe-4a30-90d5-36bd94ef1825 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:53.394137 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d57ed324-39fe-4a30-90d5-36bd94ef1825 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:53.402180 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d57ed324-39fe-4a30-90d5-36bd94ef1825 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1144 microversion: 2.1 time: 0.087271 Aug 10 16:59:53.402740 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 362/710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:53 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:53.502731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19b8a84c-8570-4db8-a165-186c91e9cd40 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:53.503349 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-19b8a84c-8570-4db8-a165-186c91e9cd40 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:53.510430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b8a84c-8570-4db8-a165-186c91e9cd40 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:53.510915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b8a84c-8570-4db8-a165-186c91e9cd40 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:53.511352 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b8a84c-8570-4db8-a165-186c91e9cd40 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:53.512042 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b8a84c-8570-4db8-a165-186c91e9cd40 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:53.512522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b8a84c-8570-4db8-a165-186c91e9cd40 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:53.512947 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b8a84c-8570-4db8-a165-186c91e9cd40 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:53.647971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-19b8a84c-8570-4db8-a165-186c91e9cd40 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:53.655600 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19b8a84c-8570-4db8-a165-186c91e9cd40 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.156679 Aug 10 16:59:53.656181 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 349/711] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:53 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:53.733240 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:53.733953 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:53.740414 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:53.740891 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:53.741314 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:53.742020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:53.742488 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:53.742882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:53.873346 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:53.881184 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:53.882717 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:53.883879 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-75c69c22-804c-4d2a-afbd-b3de00d0cb38 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.154662 Aug 10 16:59:53.884781 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 363/712] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:53 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:54.422860 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bd465d55-bf72-4434-8e82-083f8c679703 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:54.423499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bd465d55-bf72-4434-8e82-083f8c679703 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:54.429521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd465d55-bf72-4434-8e82-083f8c679703 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:54.429981 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd465d55-bf72-4434-8e82-083f8c679703 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:54.430472 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd465d55-bf72-4434-8e82-083f8c679703 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:54.431165 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd465d55-bf72-4434-8e82-083f8c679703 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:54.431602 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd465d55-bf72-4434-8e82-083f8c679703 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:54.432026 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd465d55-bf72-4434-8e82-083f8c679703 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:54.490968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bd465d55-bf72-4434-8e82-083f8c679703 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:54.499092 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bd465d55-bf72-4434-8e82-083f8c679703 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1144 microversion: 2.1 time: 0.080119 Aug 10 16:59:54.499651 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 350/713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:54 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:54.676084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0d136c14-578c-4867-beb8-c38edf74bfbb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:54.676763 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0d136c14-578c-4867-beb8-c38edf74bfbb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:54.683409 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d136c14-578c-4867-beb8-c38edf74bfbb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:54.683891 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d136c14-578c-4867-beb8-c38edf74bfbb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:54.684360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d136c14-578c-4867-beb8-c38edf74bfbb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:54.685041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d136c14-578c-4867-beb8-c38edf74bfbb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:54.685489 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d136c14-578c-4867-beb8-c38edf74bfbb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:54.685908 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d136c14-578c-4867-beb8-c38edf74bfbb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:54.811911 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0d136c14-578c-4867-beb8-c38edf74bfbb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:54.820054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0d136c14-578c-4867-beb8-c38edf74bfbb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.147732 Aug 10 16:59:54.820667 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 364/714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:54 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:54.906618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:54.907222 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:54.913561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:54.914043 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:54.914472 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:54.915319 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:54.915785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:54.916242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:55.052115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:55.059928 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:55.061446 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:55.062729 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-572ce9fb-8fdb-462b-ac64-2e9164b5c5d5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.159838 Aug 10 16:59:55.063455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 351/715] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:54 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:55.520136 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-27fe8ac9-4307-493e-93d1-14109a94fc83 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:55.520782 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-27fe8ac9-4307-493e-93d1-14109a94fc83 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:55.526839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fe8ac9-4307-493e-93d1-14109a94fc83 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:55.527324 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fe8ac9-4307-493e-93d1-14109a94fc83 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:55.527759 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fe8ac9-4307-493e-93d1-14109a94fc83 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:55.528496 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fe8ac9-4307-493e-93d1-14109a94fc83 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:55.528944 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fe8ac9-4307-493e-93d1-14109a94fc83 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:55.529364 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fe8ac9-4307-493e-93d1-14109a94fc83 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:55.593605 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-27fe8ac9-4307-493e-93d1-14109a94fc83 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:55.602106 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-27fe8ac9-4307-493e-93d1-14109a94fc83 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1144 microversion: 2.1 time: 0.085898 Aug 10 16:59:55.603533 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 365/716] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:55 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:55.842656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-101840d3-26f1-4aeb-8848-8efb59c25fec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:55.843210 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-101840d3-26f1-4aeb-8848-8efb59c25fec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:55.849845 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-101840d3-26f1-4aeb-8848-8efb59c25fec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:55.850330 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-101840d3-26f1-4aeb-8848-8efb59c25fec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:55.850757 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-101840d3-26f1-4aeb-8848-8efb59c25fec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:55.851445 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-101840d3-26f1-4aeb-8848-8efb59c25fec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:55.851891 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-101840d3-26f1-4aeb-8848-8efb59c25fec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:55.852336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-101840d3-26f1-4aeb-8848-8efb59c25fec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:55.984808 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-101840d3-26f1-4aeb-8848-8efb59c25fec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:55.992710 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-101840d3-26f1-4aeb-8848-8efb59c25fec tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.154224 Aug 10 16:59:55.993287 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 352/717] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:55 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:56.087074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:56.087679 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:56.094084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:56.094503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:56.094936 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:56.095624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:56.096071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:56.096517 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:56.226539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:56.234503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:56.235997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:56.237172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5a9ef5c3-e553-4a2e-9590-a69641e3b6dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.154241 Aug 10 16:59:56.237731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 366/718] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:56 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 16:59:56.624400 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-485f6d2e-9498-41d2-8de3-68efdc224a24 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:56.624932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-485f6d2e-9498-41d2-8de3-68efdc224a24 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:56.631810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485f6d2e-9498-41d2-8de3-68efdc224a24 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:56.632333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485f6d2e-9498-41d2-8de3-68efdc224a24 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:56.632766 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485f6d2e-9498-41d2-8de3-68efdc224a24 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:56.633464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485f6d2e-9498-41d2-8de3-68efdc224a24 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:56.633921 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485f6d2e-9498-41d2-8de3-68efdc224a24 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:56.634345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485f6d2e-9498-41d2-8de3-68efdc224a24 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:56.714926 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-485f6d2e-9498-41d2-8de3-68efdc224a24 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:56.722605 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-485f6d2e-9498-41d2-8de3-68efdc224a24 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1136 microversion: 2.1 time: 0.102035 Aug 10 16:59:56.723313 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 353/719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:56 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1136 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:57.015819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:57.016621 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=8 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:57.129305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4efcf259-d31a-4238-b4e3-32c5f25b917e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:57.129944 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4efcf259-d31a-4238-b4e3-32c5f25b917e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:57.135763 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4efcf259-d31a-4238-b4e3-32c5f25b917e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:57.136276 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4efcf259-d31a-4238-b4e3-32c5f25b917e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:57.136709 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4efcf259-d31a-4238-b4e3-32c5f25b917e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:57.137394 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4efcf259-d31a-4238-b4e3-32c5f25b917e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:57.137844 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4efcf259-d31a-4238-b4e3-32c5f25b917e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:57.138267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4efcf259-d31a-4238-b4e3-32c5f25b917e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:57.152980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:57.260968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:57.261573 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:57.265862 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4efcf259-d31a-4238-b4e3-32c5f25b917e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:57.267887 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:57.268409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:57.268848 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:57.270162 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:57.270542 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:57.270971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:57.273919 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4efcf259-d31a-4238-b4e3-32c5f25b917e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.262637 Aug 10 16:59:57.274486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 367/720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:57 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:57.437906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:57.453221 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:57.454717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:57.455879 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dea87ec6-f05f-470b-a509-b96b21430c51 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.198862 Aug 10 16:59:57.456652 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 354/721] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:57 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:59:57.744935 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c614606e-3ebf-467a-8a46-cec31f342017 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:57.745998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c614606e-3ebf-467a-8a46-cec31f342017 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:57.758223 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c614606e-3ebf-467a-8a46-cec31f342017 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:57.759057 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c614606e-3ebf-467a-8a46-cec31f342017 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:57.759647 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c614606e-3ebf-467a-8a46-cec31f342017 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:57.760534 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c614606e-3ebf-467a-8a46-cec31f342017 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:57.761132 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c614606e-3ebf-467a-8a46-cec31f342017 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:57.761556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c614606e-3ebf-467a-8a46-cec31f342017 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:57.840676 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c614606e-3ebf-467a-8a46-cec31f342017 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:57.861992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c614606e-3ebf-467a-8a46-cec31f342017 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1210 microversion: 2.1 time: 0.122127 Aug 10 16:59:57.870061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 368/722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:57 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:58.295072 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-98beffdb-2b61-40c0-b231-bcb964bbb6f2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:58.295681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-98beffdb-2b61-40c0-b231-bcb964bbb6f2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:58.302826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98beffdb-2b61-40c0-b231-bcb964bbb6f2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:58.303822 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98beffdb-2b61-40c0-b231-bcb964bbb6f2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:58.304330 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98beffdb-2b61-40c0-b231-bcb964bbb6f2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:58.305006 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98beffdb-2b61-40c0-b231-bcb964bbb6f2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:58.305580 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98beffdb-2b61-40c0-b231-bcb964bbb6f2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:58.305984 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98beffdb-2b61-40c0-b231-bcb964bbb6f2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:58.465019 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-98beffdb-2b61-40c0-b231-bcb964bbb6f2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:58.473524 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-98beffdb-2b61-40c0-b231-bcb964bbb6f2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.182271 Aug 10 16:59:58.487118 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 355/723] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:58 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:58.493020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:58.493781 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:58.500900 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:58.501475 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:58.501913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:58.502610 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:58.503064 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:58.503684 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:58.612342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-947cc99f-c2dc-4d79-a086-2f9193dabd95 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:58.613047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-947cc99f-c2dc-4d79-a086-2f9193dabd95 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:58.620284 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947cc99f-c2dc-4d79-a086-2f9193dabd95 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:58.621265 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947cc99f-c2dc-4d79-a086-2f9193dabd95 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:58.622472 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947cc99f-c2dc-4d79-a086-2f9193dabd95 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:58.623203 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947cc99f-c2dc-4d79-a086-2f9193dabd95 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:58.623661 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947cc99f-c2dc-4d79-a086-2f9193dabd95 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:58.624085 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947cc99f-c2dc-4d79-a086-2f9193dabd95 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:58.649351 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:58.665649 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:58.667300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:58.668681 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ee0b3a95-2b40-4f90-8d64-5907023d7af6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.180571 Aug 10 16:59:58.669321 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 369/724] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:58 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 16:59:58.714183 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-947cc99f-c2dc-4d79-a086-2f9193dabd95 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lazy-loading 'services' on Instance uuid f9e4f0e3-d478-4828-b569-74b375839bf6 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 16:59:58.790971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-947cc99f-c2dc-4d79-a086-2f9193dabd95 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6/os-volume_attachments/4b98b930-ca30-47e5-9c10-27895dc07184" status: 202 len: 0 microversion: 2.1 time: 0.182536 Aug 10 16:59:58.791565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 356/725] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 16:59:58 2022] DELETE /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6/os-volume_attachments/4b98b930-ca30-47e5-9c10-27895dc07184 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 16:59:58.891507 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b3cc6f8b-c139-4834-9fa2-efbb55f6d196 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:58.892113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b3cc6f8b-c139-4834-9fa2-efbb55f6d196 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:58.898673 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3cc6f8b-c139-4834-9fa2-efbb55f6d196 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:58.899156 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3cc6f8b-c139-4834-9fa2-efbb55f6d196 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:58.899621 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3cc6f8b-c139-4834-9fa2-efbb55f6d196 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:58.900319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3cc6f8b-c139-4834-9fa2-efbb55f6d196 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:58.900774 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3cc6f8b-c139-4834-9fa2-efbb55f6d196 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:58.901196 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b3cc6f8b-c139-4834-9fa2-efbb55f6d196 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:59.036559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b3cc6f8b-c139-4834-9fa2-efbb55f6d196 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:59.047297 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b3cc6f8b-c139-4834-9fa2-efbb55f6d196 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1278 microversion: 2.1 time: 0.158697 Aug 10 16:59:59.069839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 370/726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:58 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:59.494976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-87b53c93-08af-47c2-9636-109ba6e3be1f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:59.496392 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-87b53c93-08af-47c2-9636-109ba6e3be1f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:59.504373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b53c93-08af-47c2-9636-109ba6e3be1f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:59.505458 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b53c93-08af-47c2-9636-109ba6e3be1f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:59.506491 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b53c93-08af-47c2-9636-109ba6e3be1f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:59.507440 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b53c93-08af-47c2-9636-109ba6e3be1f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:59.508165 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b53c93-08af-47c2-9636-109ba6e3be1f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:59.508813 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b53c93-08af-47c2-9636-109ba6e3be1f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:59.630450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-76379470-5b86-47c5-b276-d15d5e7248f8 req-046d53ca-0a7b-4386-bcd5-bc9ae62a2a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6995ac7-abff-47f3-a48c-a24fc437717e", "tag": "e581d1b5-c12c-49b1-91c7-4fddf08829ab"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 16:59:59.640716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-76379470-5b86-47c5-b276-d15d5e7248f8 req-046d53ca-0a7b-4386-bcd5-bc9ae62a2a2c service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:59.641302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-76379470-5b86-47c5-b276-d15d5e7248f8 req-046d53ca-0a7b-4386-bcd5-bc9ae62a2a2c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:59.641809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-76379470-5b86-47c5-b276-d15d5e7248f8 req-046d53ca-0a7b-4386-bcd5-bc9ae62a2a2c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:59.653250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-76379470-5b86-47c5-b276-d15d5e7248f8 req-046d53ca-0a7b-4386-bcd5-bc9ae62a2a2c service nova] Creating event network-changed:e581d1b5-c12c-49b1-91c7-4fddf08829ab for instance f6995ac7-abff-47f3-a48c-a24fc437717e on hv-cinder-83602 Aug 10 16:59:59.658458 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-76379470-5b86-47c5-b276-d15d5e7248f8 req-046d53ca-0a7b-4386-bcd5-bc9ae62a2a2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032228 Aug 10 16:59:59.658978 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-87b53c93-08af-47c2-9636-109ba6e3be1f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:59.659628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 371/727] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 16:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 16:59:59.669431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-87b53c93-08af-47c2-9636-109ba6e3be1f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.178980 Aug 10 16:59:59.670046 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 357/728] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 16:59:59 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 16:59:59.693870 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 16:59:59.694551 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 16:59:59.700637 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:59.701113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:59.701541 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:59.702220 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 16:59:59.702667 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 16:59:59.703083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 16:59:59.848839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:59.856390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:59.858041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 16:59:59.859239 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8a8daaba-c50e-4f68-a462-5c4744bbba0f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.170240 Aug 10 16:59:59.859785 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 372/729] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 16:59:59 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:00.069908 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9aac3faa-cb3c-4688-a0ca-b1a7629bb0c7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:00.070523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9aac3faa-cb3c-4688-a0ca-b1a7629bb0c7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:00.076575 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aac3faa-cb3c-4688-a0ca-b1a7629bb0c7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:00.077064 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aac3faa-cb3c-4688-a0ca-b1a7629bb0c7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:00.077513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aac3faa-cb3c-4688-a0ca-b1a7629bb0c7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:00.078214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aac3faa-cb3c-4688-a0ca-b1a7629bb0c7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:00.078703 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aac3faa-cb3c-4688-a0ca-b1a7629bb0c7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:00.079135 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aac3faa-cb3c-4688-a0ca-b1a7629bb0c7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:00.224915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9aac3faa-cb3c-4688-a0ca-b1a7629bb0c7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:00.232292 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9aac3faa-cb3c-4688-a0ca-b1a7629bb0c7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1278 microversion: 2.1 time: 0.166597 Aug 10 17:00:00.232854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 358/730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:00 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:00.690663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a707a852-bc2e-41a5-a46e-95595534e4e3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:00.691790 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a707a852-bc2e-41a5-a46e-95595534e4e3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:00.698477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a707a852-bc2e-41a5-a46e-95595534e4e3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:00.698970 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a707a852-bc2e-41a5-a46e-95595534e4e3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:00.699409 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a707a852-bc2e-41a5-a46e-95595534e4e3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:00.700129 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a707a852-bc2e-41a5-a46e-95595534e4e3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:00.700607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a707a852-bc2e-41a5-a46e-95595534e4e3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:00.701034 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a707a852-bc2e-41a5-a46e-95595534e4e3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:00.829682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a707a852-bc2e-41a5-a46e-95595534e4e3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:00.837896 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a707a852-bc2e-41a5-a46e-95595534e4e3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.151210 Aug 10 17:00:00.838453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 373/731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:00 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:00.883301 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:00.883956 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:00.890373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:00.890857 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:00.891323 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:00.892047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:00.892532 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:00.892959 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:01.022612 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:01.030371 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:01.031876 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:01.033061 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9abce0c9-88f9-466e-8fdf-e108850f6ada tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.154369 Aug 10 17:00:01.033653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 359/732] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:00 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:01.252266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d4bebb9c-275a-4043-bb26-d7749d7fbe52 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:01.252876 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d4bebb9c-275a-4043-bb26-d7749d7fbe52 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:01.259364 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4bebb9c-275a-4043-bb26-d7749d7fbe52 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:01.259847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4bebb9c-275a-4043-bb26-d7749d7fbe52 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:01.260313 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4bebb9c-275a-4043-bb26-d7749d7fbe52 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:01.260999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4bebb9c-275a-4043-bb26-d7749d7fbe52 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:01.261451 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4bebb9c-275a-4043-bb26-d7749d7fbe52 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:01.261871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4bebb9c-275a-4043-bb26-d7749d7fbe52 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:01.391164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d4bebb9c-275a-4043-bb26-d7749d7fbe52 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:01.402967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d4bebb9c-275a-4043-bb26-d7749d7fbe52 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1278 microversion: 2.1 time: 0.154453 Aug 10 17:00:01.403628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 374/733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:01 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:01.596311 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-2e57aa0b-a3f2-4012-ac2a-395362a58b87 req-d5ac1d95-9bbd-4028-a059-96abb67b0bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ed24c9-1f9e-48fa-94f0-773f2963e5b9", "name": "network-vif-plugged", "status": "completed", "tag": "e32f7fef-5326-4138-b204-5b508dd1425c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:00:01.608091 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2e57aa0b-a3f2-4012-ac2a-395362a58b87 req-d5ac1d95-9bbd-4028-a059-96abb67b0bf5 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:01.608621 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2e57aa0b-a3f2-4012-ac2a-395362a58b87 req-d5ac1d95-9bbd-4028-a059-96abb67b0bf5 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:01.609263 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2e57aa0b-a3f2-4012-ac2a-395362a58b87 req-d5ac1d95-9bbd-4028-a059-96abb67b0bf5 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:01.621667 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-2e57aa0b-a3f2-4012-ac2a-395362a58b87 req-d5ac1d95-9bbd-4028-a059-96abb67b0bf5 service nova] Creating event network-vif-plugged:e32f7fef-5326-4138-b204-5b508dd1425c for instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 on hv-cinder-83602 Aug 10 17:00:01.626379 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-2e57aa0b-a3f2-4012-ac2a-395362a58b87 req-d5ac1d95-9bbd-4028-a059-96abb67b0bf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033953 Aug 10 17:00:01.627158 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 360/734] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:00:01.859283 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5283a9d5-ec15-4b96-bbf9-021a404b811d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:01.859887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5283a9d5-ec15-4b96-bbf9-021a404b811d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:01.866237 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5283a9d5-ec15-4b96-bbf9-021a404b811d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:01.866713 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5283a9d5-ec15-4b96-bbf9-021a404b811d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:01.867137 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5283a9d5-ec15-4b96-bbf9-021a404b811d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:01.867815 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5283a9d5-ec15-4b96-bbf9-021a404b811d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:01.868388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5283a9d5-ec15-4b96-bbf9-021a404b811d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:01.868809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5283a9d5-ec15-4b96-bbf9-021a404b811d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:01.996076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5283a9d5-ec15-4b96-bbf9-021a404b811d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:02.003498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5283a9d5-ec15-4b96-bbf9-021a404b811d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.148991 Aug 10 17:00:02.003988 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 375/735] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:01 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:02.159340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:02.160030 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:02.166160 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:02.166635 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:02.167066 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:02.167745 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:02.168214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:02.168638 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:02.299757 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:02.307721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:02.309246 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:02.310395 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7465e8b9-b93d-457e-ad97-045636d426b1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.258364 Aug 10 17:00:02.310946 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 361/736] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:02 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:02.424286 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-05e0da5a-64e7-447d-960e-54bf18d41a47 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:02.424889 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-05e0da5a-64e7-447d-960e-54bf18d41a47 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:02.431608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05e0da5a-64e7-447d-960e-54bf18d41a47 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:02.432084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05e0da5a-64e7-447d-960e-54bf18d41a47 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:02.432546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05e0da5a-64e7-447d-960e-54bf18d41a47 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:02.433232 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05e0da5a-64e7-447d-960e-54bf18d41a47 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:02.433674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05e0da5a-64e7-447d-960e-54bf18d41a47 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:02.434089 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05e0da5a-64e7-447d-960e-54bf18d41a47 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:02.562659 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-05e0da5a-64e7-447d-960e-54bf18d41a47 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:02.570577 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-05e0da5a-64e7-447d-960e-54bf18d41a47 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1278 microversion: 2.1 time: 0.150173 Aug 10 17:00:02.571134 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 376/737] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:02 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:03.024836 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2c9bafbe-552e-4120-8120-2ddbe3aa5ba7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:03.025473 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2c9bafbe-552e-4120-8120-2ddbe3aa5ba7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:03.031386 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c9bafbe-552e-4120-8120-2ddbe3aa5ba7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:03.031865 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c9bafbe-552e-4120-8120-2ddbe3aa5ba7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:03.032322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c9bafbe-552e-4120-8120-2ddbe3aa5ba7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:03.033022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c9bafbe-552e-4120-8120-2ddbe3aa5ba7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:03.033465 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c9bafbe-552e-4120-8120-2ddbe3aa5ba7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:03.033886 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c9bafbe-552e-4120-8120-2ddbe3aa5ba7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:03.159864 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2c9bafbe-552e-4120-8120-2ddbe3aa5ba7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:03.167318 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2c9bafbe-552e-4120-8120-2ddbe3aa5ba7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.147003 Aug 10 17:00:03.167836 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 362/738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:03 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:03.334127 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:03.335276 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:03.341936 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:03.342432 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:03.342868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:03.343573 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:03.344027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:03.344500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:03.486895 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:03.495649 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:03.497545 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:03.498826 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2da6ad19-ed63-4ec9-b563-07ca458b54ea tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.168770 Aug 10 17:00:03.499440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 377/739] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:03 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:03.590903 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee17dd0d-1738-41ae-ac4b-0c99ecbf0e75 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:03.591615 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee17dd0d-1738-41ae-ac4b-0c99ecbf0e75 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:03.597724 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee17dd0d-1738-41ae-ac4b-0c99ecbf0e75 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:03.598213 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee17dd0d-1738-41ae-ac4b-0c99ecbf0e75 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:03.599243 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee17dd0d-1738-41ae-ac4b-0c99ecbf0e75 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:03.599942 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee17dd0d-1738-41ae-ac4b-0c99ecbf0e75 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:03.600423 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee17dd0d-1738-41ae-ac4b-0c99ecbf0e75 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:03.600853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee17dd0d-1738-41ae-ac4b-0c99ecbf0e75 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:03.736305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ee17dd0d-1738-41ae-ac4b-0c99ecbf0e75 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:03.744618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ee17dd0d-1738-41ae-ac4b-0c99ecbf0e75 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1278 microversion: 2.1 time: 0.157431 Aug 10 17:00:03.745188 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 363/740] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:03 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:04.187718 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-89f3c33d-38b2-4143-b5c0-a3ef78a7b7d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:04.188367 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-89f3c33d-38b2-4143-b5c0-a3ef78a7b7d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:04.194819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f3c33d-38b2-4143-b5c0-a3ef78a7b7d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:04.195310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f3c33d-38b2-4143-b5c0-a3ef78a7b7d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:04.195743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f3c33d-38b2-4143-b5c0-a3ef78a7b7d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:04.196458 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f3c33d-38b2-4143-b5c0-a3ef78a7b7d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:04.196910 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f3c33d-38b2-4143-b5c0-a3ef78a7b7d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:04.197335 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f3c33d-38b2-4143-b5c0-a3ef78a7b7d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:04.326841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-89f3c33d-38b2-4143-b5c0-a3ef78a7b7d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:04.335034 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-89f3c33d-38b2-4143-b5c0-a3ef78a7b7d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.151080 Aug 10 17:00:04.335522 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 378/741] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:04 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:04.481203 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-603e28f6-eaf7-4999-a601-8442259fb038 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:00:04.483647 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=72 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:04.488996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603e28f6-eaf7-4999-a601-8442259fb038 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:04.489482 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603e28f6-eaf7-4999-a601-8442259fb038 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:04.489915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603e28f6-eaf7-4999-a601-8442259fb038 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:04.522664 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:04.523376 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:04.530002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:04.530614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:04.531052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:04.531764 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:04.532240 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:04.532690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:04.540047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:04.552989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-603e28f6-eaf7-4999-a601-8442259fb038 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Going to try to stop instance {{(pid=120614) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 17:00:04.597232 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-603e28f6-eaf7-4999-a601-8442259fb038 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "POST /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/action" status: 202 len: 0 microversion: 2.1 time: 0.119618 Aug 10 17:00:04.598193 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 364/742] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 17:00:04 2022] POST /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:00:04.606347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f820321e-5d15-4a67-b52b-c04cb90a5391 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:04.607043 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f820321e-5d15-4a67-b52b-c04cb90a5391 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:04.613020 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f820321e-5d15-4a67-b52b-c04cb90a5391 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:04.613543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f820321e-5d15-4a67-b52b-c04cb90a5391 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:04.614481 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f820321e-5d15-4a67-b52b-c04cb90a5391 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:04.615184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f820321e-5d15-4a67-b52b-c04cb90a5391 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:04.615642 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f820321e-5d15-4a67-b52b-c04cb90a5391 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:04.616070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f820321e-5d15-4a67-b52b-c04cb90a5391 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:04.666686 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:04.674537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:04.676014 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:04.677879 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8a510ae8-9f63-463c-b481-6aebd96b9a56 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.159656 Aug 10 17:00:04.678429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 379/743] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:04 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:00:04.746726 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f820321e-5d15-4a67-b52b-c04cb90a5391 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:04.756277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f820321e-5d15-4a67-b52b-c04cb90a5391 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.153787 Aug 10 17:00:04.756850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 365/744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:04 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:04.765414 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c45e5419-d17d-4453-83bd-1b93270d59d2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:04.766053 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c45e5419-d17d-4453-83bd-1b93270d59d2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:04.772508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c45e5419-d17d-4453-83bd-1b93270d59d2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:04.772986 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c45e5419-d17d-4453-83bd-1b93270d59d2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:04.773456 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c45e5419-d17d-4453-83bd-1b93270d59d2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:04.774140 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c45e5419-d17d-4453-83bd-1b93270d59d2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:04.774594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c45e5419-d17d-4453-83bd-1b93270d59d2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:04.775041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c45e5419-d17d-4453-83bd-1b93270d59d2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:04.907628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c45e5419-d17d-4453-83bd-1b93270d59d2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:04.915563 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c45e5419-d17d-4453-83bd-1b93270d59d2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1278 microversion: 2.1 time: 0.153934 Aug 10 17:00:04.916112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 380/745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:04 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:05.355351 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d166d74a-a045-4b33-9c6a-783e650c3306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:05.355955 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d166d74a-a045-4b33-9c6a-783e650c3306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:05.362017 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d166d74a-a045-4b33-9c6a-783e650c3306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:05.362500 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d166d74a-a045-4b33-9c6a-783e650c3306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:05.362928 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d166d74a-a045-4b33-9c6a-783e650c3306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:05.363608 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d166d74a-a045-4b33-9c6a-783e650c3306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:05.364107 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d166d74a-a045-4b33-9c6a-783e650c3306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:05.364550 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d166d74a-a045-4b33-9c6a-783e650c3306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:05.500317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d166d74a-a045-4b33-9c6a-783e650c3306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:05.507931 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d166d74a-a045-4b33-9c6a-783e650c3306 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1367 microversion: 2.1 time: 0.156407 Aug 10 17:00:05.508655 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 366/746] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:05 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:05.576876 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-53197400-de19-4386-8c75-bdb147744e24 req-e9a440ba-22ab-44a9-9943-399290a68b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c45104f-0ee5-4fec-92ad-7937cbe53805", "name": "network-vif-plugged", "status": "completed", "tag": "da10f762-bc62-4992-aee6-1b182938963c"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:00:05.588526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-53197400-de19-4386-8c75-bdb147744e24 req-e9a440ba-22ab-44a9-9943-399290a68b2d service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:05.589004 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-53197400-de19-4386-8c75-bdb147744e24 req-e9a440ba-22ab-44a9-9943-399290a68b2d service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:05.589524 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-53197400-de19-4386-8c75-bdb147744e24 req-e9a440ba-22ab-44a9-9943-399290a68b2d service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:05.602307 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-53197400-de19-4386-8c75-bdb147744e24 req-e9a440ba-22ab-44a9-9943-399290a68b2d service nova] Creating event network-vif-plugged:da10f762-bc62-4992-aee6-1b182938963c for instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 on hv-cinder-83602 Aug 10 17:00:05.607123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-53197400-de19-4386-8c75-bdb147744e24 req-e9a440ba-22ab-44a9-9943-399290a68b2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033962 Aug 10 17:00:05.607704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 381/747] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:00:05.701369 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:05.702010 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:05.708734 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:05.709205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:05.709636 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:05.710314 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:05.710761 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:05.711183 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:05.778153 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b9301fb8-94e8-44a2-8be3-0c556cfdacee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:05.778952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b9301fb8-94e8-44a2-8be3-0c556cfdacee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:05.785266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9301fb8-94e8-44a2-8be3-0c556cfdacee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:05.785845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9301fb8-94e8-44a2-8be3-0c556cfdacee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:05.786393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9301fb8-94e8-44a2-8be3-0c556cfdacee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:05.787165 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9301fb8-94e8-44a2-8be3-0c556cfdacee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:05.787702 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9301fb8-94e8-44a2-8be3-0c556cfdacee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:05.788225 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9301fb8-94e8-44a2-8be3-0c556cfdacee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:05.844658 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:05.853514 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:05.855379 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:05.856566 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dad5a554-af8a-4ac5-8d8e-72a8619c119e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.158600 Aug 10 17:00:05.857128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 367/748] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:05 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:05.919626 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b9301fb8-94e8-44a2-8be3-0c556cfdacee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:05.927563 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b9301fb8-94e8-44a2-8be3-0c556cfdacee tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.153742 Aug 10 17:00:05.928121 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 382/749] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:05 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:05.936298 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3a069092-953b-4ee2-be33-a2c49e359e07 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:05.936935 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3a069092-953b-4ee2-be33-a2c49e359e07 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:05.943212 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a069092-953b-4ee2-be33-a2c49e359e07 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:05.943695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a069092-953b-4ee2-be33-a2c49e359e07 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:05.944166 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a069092-953b-4ee2-be33-a2c49e359e07 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:05.944859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a069092-953b-4ee2-be33-a2c49e359e07 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:05.945312 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a069092-953b-4ee2-be33-a2c49e359e07 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:05.945741 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a069092-953b-4ee2-be33-a2c49e359e07 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:06.073484 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-3a069092-953b-4ee2-be33-a2c49e359e07 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:06.080923 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3a069092-953b-4ee2-be33-a2c49e359e07 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1278 microversion: 2.1 time: 0.148381 Aug 10 17:00:06.081511 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 368/750] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:05 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:06.529124 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9a61e9d5-77f9-4696-8fb6-e0bdbfb161ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:06.529728 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9a61e9d5-77f9-4696-8fb6-e0bdbfb161ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:06.535491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a61e9d5-77f9-4696-8fb6-e0bdbfb161ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:06.536498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a61e9d5-77f9-4696-8fb6-e0bdbfb161ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:06.536926 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a61e9d5-77f9-4696-8fb6-e0bdbfb161ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:06.537602 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a61e9d5-77f9-4696-8fb6-e0bdbfb161ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:06.538045 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a61e9d5-77f9-4696-8fb6-e0bdbfb161ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:06.538460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a61e9d5-77f9-4696-8fb6-e0bdbfb161ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:06.666113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9a61e9d5-77f9-4696-8fb6-e0bdbfb161ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:06.673550 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9a61e9d5-77f9-4696-8fb6-e0bdbfb161ee tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1557 microversion: 2.1 time: 0.148294 Aug 10 17:00:06.674115 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 383/751] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:06 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:06.693810 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-92e346fb-f2ff-4788-90fb-a62322a2b0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:06.694307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-92e346fb-f2ff-4788-90fb-a62322a2b0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:06.700734 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92e346fb-f2ff-4788-90fb-a62322a2b0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:06.701225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92e346fb-f2ff-4788-90fb-a62322a2b0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:06.701664 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92e346fb-f2ff-4788-90fb-a62322a2b0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:06.702359 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92e346fb-f2ff-4788-90fb-a62322a2b0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:06.702817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92e346fb-f2ff-4788-90fb-a62322a2b0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:06.703253 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92e346fb-f2ff-4788-90fb-a62322a2b0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:06.783380 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-92e346fb-f2ff-4788-90fb-a62322a2b0c3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093878 Aug 10 17:00:06.784020 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 369/752] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 10 17:00:06 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:00:06.878894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:06.880082 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:06.885931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:06.886410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:06.886838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:06.887524 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:06.887967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:06.888405 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:06.952440 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a19b7d7-fa05-4753-af20-f51d2b1f2be9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:06.953286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a19b7d7-fa05-4753-af20-f51d2b1f2be9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:06.960481 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a19b7d7-fa05-4753-af20-f51d2b1f2be9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:06.961161 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a19b7d7-fa05-4753-af20-f51d2b1f2be9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:06.961970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a19b7d7-fa05-4753-af20-f51d2b1f2be9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:06.962859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a19b7d7-fa05-4753-af20-f51d2b1f2be9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:06.963322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a19b7d7-fa05-4753-af20-f51d2b1f2be9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:06.963749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a19b7d7-fa05-4753-af20-f51d2b1f2be9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:07.023941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:07.031961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:07.033512 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:07.034710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c8ba397f-ae24-4548-a104-c5f3f3461a19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.159775 Aug 10 17:00:07.035265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 384/753] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:06 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:07.102101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a844efff-2515-412a-9963-d0371b2d9380 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:07.102707 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a844efff-2515-412a-9963-d0371b2d9380 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:07.108648 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a844efff-2515-412a-9963-d0371b2d9380 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:07.109256 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a844efff-2515-412a-9963-d0371b2d9380 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:07.109687 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a844efff-2515-412a-9963-d0371b2d9380 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:07.110371 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a844efff-2515-412a-9963-d0371b2d9380 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:07.110825 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a844efff-2515-412a-9963-d0371b2d9380 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:07.111251 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a844efff-2515-412a-9963-d0371b2d9380 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:07.126858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:07.203954 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8a19b7d7-fa05-4753-af20-f51d2b1f2be9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:07.212184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a19b7d7-fa05-4753-af20-f51d2b1f2be9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.266310 Aug 10 17:00:07.224019 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 370/754] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:06 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:07.241711 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a844efff-2515-412a-9963-d0371b2d9380 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:07.249239 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a844efff-2515-412a-9963-d0371b2d9380 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.151081 Aug 10 17:00:07.250126 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 385/755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:07 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:07.778869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-35f48e21-8594-4d9c-ac20-e94d576eab41 req-253efdaf-703e-4daa-91c0-58c42bc96fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ed24c9-1f9e-48fa-94f0-773f2963e5b9", "tag": "e32f7fef-5326-4138-b204-5b508dd1425c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:00:07.789459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-35f48e21-8594-4d9c-ac20-e94d576eab41 req-253efdaf-703e-4daa-91c0-58c42bc96fa7 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:07.790493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-35f48e21-8594-4d9c-ac20-e94d576eab41 req-253efdaf-703e-4daa-91c0-58c42bc96fa7 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:07.790493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-35f48e21-8594-4d9c-ac20-e94d576eab41 req-253efdaf-703e-4daa-91c0-58c42bc96fa7 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:07.801554 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-35f48e21-8594-4d9c-ac20-e94d576eab41 req-253efdaf-703e-4daa-91c0-58c42bc96fa7 service nova] Creating event network-changed:e32f7fef-5326-4138-b204-5b508dd1425c for instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 on hv-cinder-83602 Aug 10 17:00:07.806389 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-35f48e21-8594-4d9c-ac20-e94d576eab41 req-253efdaf-703e-4daa-91c0-58c42bc96fa7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031115 Aug 10 17:00:07.806990 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 371/756] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:00:08.057504 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:08.058222 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:08.065459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:08.066043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:08.066548 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:08.067922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:08.068471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:08.068961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:08.201315 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:08.209644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:08.211143 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:08.212515 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2045ed3f-84b3-492a-8818-144222000eff tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.158873 Aug 10 17:00:08.213080 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 386/757] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:08 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:08.233801 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4d9740f6-fe4a-43a5-8de5-64fa5d537102 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:08.234474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d9740f6-fe4a-43a5-8de5-64fa5d537102 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:08.241091 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9740f6-fe4a-43a5-8de5-64fa5d537102 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:08.241574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9740f6-fe4a-43a5-8de5-64fa5d537102 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:08.242003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9740f6-fe4a-43a5-8de5-64fa5d537102 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:08.242693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9740f6-fe4a-43a5-8de5-64fa5d537102 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:08.243148 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9740f6-fe4a-43a5-8de5-64fa5d537102 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:08.243565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9740f6-fe4a-43a5-8de5-64fa5d537102 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:08.270662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b65b1366-bc12-4c8c-a029-a0c312573595 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:08.271302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b65b1366-bc12-4c8c-a029-a0c312573595 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:08.277346 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b65b1366-bc12-4c8c-a029-a0c312573595 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:08.277829 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b65b1366-bc12-4c8c-a029-a0c312573595 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:08.278258 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b65b1366-bc12-4c8c-a029-a0c312573595 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:08.278951 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b65b1366-bc12-4c8c-a029-a0c312573595 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:08.279400 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b65b1366-bc12-4c8c-a029-a0c312573595 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:08.279820 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b65b1366-bc12-4c8c-a029-a0c312573595 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:08.380483 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d9740f6-fe4a-43a5-8de5-64fa5d537102 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:08.390147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4d9740f6-fe4a-43a5-8de5-64fa5d537102 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.160471 Aug 10 17:00:08.391352 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 372/758] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:08 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:08.419645 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b65b1366-bc12-4c8c-a029-a0c312573595 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:08.433561 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b65b1366-bc12-4c8c-a029-a0c312573595 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.166605 Aug 10 17:00:08.434140 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 387/759] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:08 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:09.235483 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:09.236083 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:09.242957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:09.243434 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:09.243864 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:09.244570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:09.245017 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:09.245439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:09.373173 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:09.381587 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:09.383056 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:09.384231 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-49580e89-a0ed-444a-8ca2-f9449bbfe188 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.152595 Aug 10 17:00:09.384778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 373/760] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:09 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:09.411968 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3069e2a6-0215-486b-9569-c15bcfc0b959 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:09.412626 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3069e2a6-0215-486b-9569-c15bcfc0b959 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:09.419750 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3069e2a6-0215-486b-9569-c15bcfc0b959 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:09.420305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3069e2a6-0215-486b-9569-c15bcfc0b959 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:09.420734 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3069e2a6-0215-486b-9569-c15bcfc0b959 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:09.421425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3069e2a6-0215-486b-9569-c15bcfc0b959 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:09.421872 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3069e2a6-0215-486b-9569-c15bcfc0b959 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:09.422289 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3069e2a6-0215-486b-9569-c15bcfc0b959 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:09.454821 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0dbf4617-53b2-4a9d-930f-150a316065f0 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:09.455444 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0dbf4617-53b2-4a9d-930f-150a316065f0 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:09.462190 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dbf4617-53b2-4a9d-930f-150a316065f0 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:09.462681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dbf4617-53b2-4a9d-930f-150a316065f0 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:09.463116 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dbf4617-53b2-4a9d-930f-150a316065f0 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:09.463816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dbf4617-53b2-4a9d-930f-150a316065f0 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:09.464307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dbf4617-53b2-4a9d-930f-150a316065f0 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:09.464893 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dbf4617-53b2-4a9d-930f-150a316065f0 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:09.597738 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0dbf4617-53b2-4a9d-930f-150a316065f0 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:09.617530 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0dbf4617-53b2-4a9d-930f-150a316065f0 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.166561 Aug 10 17:00:09.618222 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 374/761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:09 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:09.634564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3069e2a6-0215-486b-9569-c15bcfc0b959 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:09.642772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3069e2a6-0215-486b-9569-c15bcfc0b959 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.234949 Aug 10 17:00:09.643361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 388/762] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:09 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:10.405838 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:10.406486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:10.413050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:10.413536 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:10.413972 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:10.414662 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:10.415115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:10.415540 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:10.499271 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dc4a4fc2-7afd-4762-aceb-a1e692ced094 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:10.499751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-dc4a4fc2-7afd-4762-aceb-a1e692ced094 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:10.502053 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:10.507876 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc4a4fc2-7afd-4762-aceb-a1e692ced094 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:10.508394 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc4a4fc2-7afd-4762-aceb-a1e692ced094 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:10.508830 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc4a4fc2-7afd-4762-aceb-a1e692ced094 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:10.509526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc4a4fc2-7afd-4762-aceb-a1e692ced094 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:10.509972 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc4a4fc2-7afd-4762-aceb-a1e692ced094 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:10.510396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc4a4fc2-7afd-4762-aceb-a1e692ced094 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:10.536546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-dc4a4fc2-7afd-4762-aceb-a1e692ced094 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:00:10.545491 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:10.553371 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:10.554955 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:10.556232 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-21927b1d-0598-4eb4-a86a-b896c186d87f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.154374 Aug 10 17:00:10.556869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 375/763] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:10 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:10.609714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-dc4a4fc2-7afd-4762-aceb-a1e692ced094 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 204 len: 0 microversion: 2.1 time: 0.113948 Aug 10 17:00:10.610464 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 389/764] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:00:10 2022] DELETE /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:00:10.619295 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9f80ca21-0bc1-4eb0-b868-5167e6c97164 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:10.619908 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9f80ca21-0bc1-4eb0-b868-5167e6c97164 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:10.625811 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f80ca21-0bc1-4eb0-b868-5167e6c97164 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:10.626300 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f80ca21-0bc1-4eb0-b868-5167e6c97164 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:10.626735 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f80ca21-0bc1-4eb0-b868-5167e6c97164 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:10.627426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f80ca21-0bc1-4eb0-b868-5167e6c97164 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:10.627883 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f80ca21-0bc1-4eb0-b868-5167e6c97164 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:10.628355 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f80ca21-0bc1-4eb0-b868-5167e6c97164 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:10.637508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4bed7c8c-0862-42fd-a8a0-fef8dd8c7dd1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:10.638227 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4bed7c8c-0862-42fd-a8a0-fef8dd8c7dd1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:10.644032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bed7c8c-0862-42fd-a8a0-fef8dd8c7dd1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:10.644544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bed7c8c-0862-42fd-a8a0-fef8dd8c7dd1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:10.645499 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bed7c8c-0862-42fd-a8a0-fef8dd8c7dd1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:10.646183 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bed7c8c-0862-42fd-a8a0-fef8dd8c7dd1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:10.646632 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bed7c8c-0862-42fd-a8a0-fef8dd8c7dd1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:10.647054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bed7c8c-0862-42fd-a8a0-fef8dd8c7dd1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:10.762113 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9f80ca21-0bc1-4eb0-b868-5167e6c97164 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:10.769572 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9f80ca21-0bc1-4eb0-b868-5167e6c97164 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1513 microversion: 2.1 time: 0.154166 Aug 10 17:00:10.770657 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 376/765] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:10 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:10.775073 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7bb93bd1-832e-49a9-bcfe-e5c29d1f790f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:10.775669 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7bb93bd1-832e-49a9-bcfe-e5c29d1f790f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:10.781453 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb93bd1-832e-49a9-bcfe-e5c29d1f790f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:10.781941 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb93bd1-832e-49a9-bcfe-e5c29d1f790f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:10.782372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb93bd1-832e-49a9-bcfe-e5c29d1f790f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:10.783067 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb93bd1-832e-49a9-bcfe-e5c29d1f790f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:10.783516 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb93bd1-832e-49a9-bcfe-e5c29d1f790f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:10.783935 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb93bd1-832e-49a9-bcfe-e5c29d1f790f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:10.795010 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4bed7c8c-0862-42fd-a8a0-fef8dd8c7dd1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:10.802443 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4bed7c8c-0862-42fd-a8a0-fef8dd8c7dd1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.169161 Aug 10 17:00:10.803003 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 390/766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:10 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:10.922014 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7bb93bd1-832e-49a9-bcfe-e5c29d1f790f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:10.929921 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7bb93bd1-832e-49a9-bcfe-e5c29d1f790f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.158348 Aug 10 17:00:10.930482 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 377/767] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:10 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:11.583781 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:11.584464 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:11.590690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:11.591187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:11.591625 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:11.592356 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:11.592812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:11.593235 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:11.728162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:11.735864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:11.737370 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:11.738504 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6f319da4-6b68-4b93-8c91-69a4bfe5204b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.159430 Aug 10 17:00:11.739757 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 391/768] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:11 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:11.791217 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-57befdd8-1c51-493c-9f65-115397815930 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:11.791829 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-57befdd8-1c51-493c-9f65-115397815930 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:11.798399 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57befdd8-1c51-493c-9f65-115397815930 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:11.798884 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57befdd8-1c51-493c-9f65-115397815930 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:11.799323 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57befdd8-1c51-493c-9f65-115397815930 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:11.800045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57befdd8-1c51-493c-9f65-115397815930 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:11.800525 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57befdd8-1c51-493c-9f65-115397815930 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:11.800960 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57befdd8-1c51-493c-9f65-115397815930 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:11.822727 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-04a5f3b4-4869-42b3-80fe-b9abdef575b4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:11.823357 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-04a5f3b4-4869-42b3-80fe-b9abdef575b4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:11.829081 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a5f3b4-4869-42b3-80fe-b9abdef575b4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:11.829568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a5f3b4-4869-42b3-80fe-b9abdef575b4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:11.829992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a5f3b4-4869-42b3-80fe-b9abdef575b4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:11.830670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a5f3b4-4869-42b3-80fe-b9abdef575b4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:11.831115 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a5f3b4-4869-42b3-80fe-b9abdef575b4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:11.831532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04a5f3b4-4869-42b3-80fe-b9abdef575b4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:11.937532 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-57befdd8-1c51-493c-9f65-115397815930 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:11.947060 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-57befdd8-1c51-493c-9f65-115397815930 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1513 microversion: 2.1 time: 0.159666 Aug 10 17:00:11.947635 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 378/769] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:11 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:11.952028 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce383e80-1f58-4979-9bcc-5e1700b3846c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:11.952657 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ce383e80-1f58-4979-9bcc-5e1700b3846c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:11.959213 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce383e80-1f58-4979-9bcc-5e1700b3846c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:11.959692 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce383e80-1f58-4979-9bcc-5e1700b3846c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:11.960122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce383e80-1f58-4979-9bcc-5e1700b3846c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:11.960831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce383e80-1f58-4979-9bcc-5e1700b3846c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:11.961283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce383e80-1f58-4979-9bcc-5e1700b3846c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:11.961735 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce383e80-1f58-4979-9bcc-5e1700b3846c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:11.978904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-04a5f3b4-4869-42b3-80fe-b9abdef575b4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:11.986247 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-04a5f3b4-4869-42b3-80fe-b9abdef575b4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.167282 Aug 10 17:00:11.987048 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 392/770] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:11 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:12.087933 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce383e80-1f58-4979-9bcc-5e1700b3846c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:12.095689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce383e80-1f58-4979-9bcc-5e1700b3846c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.147132 Aug 10 17:00:12.096266 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 379/771] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:11 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:12.761715 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:12.762341 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:12.768712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:12.769193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:12.769620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:12.770305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:12.770749 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:12.771178 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:12.897130 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:12.904969 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:12.906486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:12.907626 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-efe0fd21-73fb-4534-a5e4-cd5423f7cedd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1744 microversion: 2.20 time: 0.149915 Aug 10 17:00:12.908190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 393/772] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:12 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:12.968550 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c85cec57-3145-4230-9373-b43e66a88fa2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:12.969160 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c85cec57-3145-4230-9373-b43e66a88fa2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:12.975513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c85cec57-3145-4230-9373-b43e66a88fa2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:12.976647 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c85cec57-3145-4230-9373-b43e66a88fa2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:12.977099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c85cec57-3145-4230-9373-b43e66a88fa2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:12.977807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c85cec57-3145-4230-9373-b43e66a88fa2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:12.978265 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c85cec57-3145-4230-9373-b43e66a88fa2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:12.978693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c85cec57-3145-4230-9373-b43e66a88fa2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:13.007134 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3b531500-c0b1-428a-a438-8da6e8cbd1e7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:13.007748 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3b531500-c0b1-428a-a438-8da6e8cbd1e7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:13.013871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b531500-c0b1-428a-a438-8da6e8cbd1e7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:13.014286 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b531500-c0b1-428a-a438-8da6e8cbd1e7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:13.014720 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b531500-c0b1-428a-a438-8da6e8cbd1e7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:13.015411 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b531500-c0b1-428a-a438-8da6e8cbd1e7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:13.015862 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b531500-c0b1-428a-a438-8da6e8cbd1e7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:13.016321 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b531500-c0b1-428a-a438-8da6e8cbd1e7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:13.121241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c85cec57-3145-4230-9373-b43e66a88fa2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:13.129100 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c85cec57-3145-4230-9373-b43e66a88fa2 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1513 microversion: 2.1 time: 0.164477 Aug 10 17:00:13.130377 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 380/773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:12 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:13.134771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0423f4d1-ec52-44ce-8567-4a094e34893b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:13.135533 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0423f4d1-ec52-44ce-8567-4a094e34893b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:13.143291 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0423f4d1-ec52-44ce-8567-4a094e34893b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:13.143789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0423f4d1-ec52-44ce-8567-4a094e34893b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:13.144250 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0423f4d1-ec52-44ce-8567-4a094e34893b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:13.145597 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0423f4d1-ec52-44ce-8567-4a094e34893b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:13.146057 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0423f4d1-ec52-44ce-8567-4a094e34893b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:13.146609 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0423f4d1-ec52-44ce-8567-4a094e34893b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:13.150918 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:13.161465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3b531500-c0b1-428a-a438-8da6e8cbd1e7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:13.169358 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3b531500-c0b1-428a-a438-8da6e8cbd1e7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.166565 Aug 10 17:00:13.170028 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 394/774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:13 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:13.505329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0423f4d1-ec52-44ce-8567-4a094e34893b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:13.513247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0423f4d1-ec52-44ce-8567-4a094e34893b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.382052 Aug 10 17:00:13.513812 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 381/775] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:13 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:13.931382 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:13.931996 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:13.938901 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:13.939386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:13.939874 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:13.944576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:13.944576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:13.944576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:14.150991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e65345c9-a93b-44e3-ade2-5d4eb0db8414 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:14.152181 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e65345c9-a93b-44e3-ade2-5d4eb0db8414 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:14.158717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e65345c9-a93b-44e3-ade2-5d4eb0db8414 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:14.159368 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e65345c9-a93b-44e3-ade2-5d4eb0db8414 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:14.159982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e65345c9-a93b-44e3-ade2-5d4eb0db8414 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:14.161301 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e65345c9-a93b-44e3-ade2-5d4eb0db8414 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:14.161924 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e65345c9-a93b-44e3-ade2-5d4eb0db8414 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:14.162348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e65345c9-a93b-44e3-ade2-5d4eb0db8414 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:14.180405 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:14.195301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:14.197435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:14.198607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-33ab9dda-53dc-4807-8e79-871fdc2b6224 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.271153 Aug 10 17:00:14.199660 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 395/776] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:13 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:14.204476 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-77d0552e-a8a4-44a5-8850-0aa1b066a385 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:14.205075 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-77d0552e-a8a4-44a5-8850-0aa1b066a385 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:14.211909 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d0552e-a8a4-44a5-8850-0aa1b066a385 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:14.212608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d0552e-a8a4-44a5-8850-0aa1b066a385 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:14.213224 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d0552e-a8a4-44a5-8850-0aa1b066a385 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:14.214071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d0552e-a8a4-44a5-8850-0aa1b066a385 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:14.214693 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d0552e-a8a4-44a5-8850-0aa1b066a385 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:14.215119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d0552e-a8a4-44a5-8850-0aa1b066a385 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:14.367992 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e65345c9-a93b-44e3-ade2-5d4eb0db8414 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:14.377957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e65345c9-a93b-44e3-ade2-5d4eb0db8414 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1513 microversion: 2.1 time: 0.230772 Aug 10 17:00:14.378635 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 382/777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:14 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:14.474375 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-77d0552e-a8a4-44a5-8850-0aa1b066a385 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:14.482906 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-77d0552e-a8a4-44a5-8850-0aa1b066a385 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.281907 Aug 10 17:00:14.483473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 396/778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:14 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:14.535245 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c70592e2-0392-4922-bc89-73925c0cb4be tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:14.536139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c70592e2-0392-4922-bc89-73925c0cb4be tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:14.546844 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70592e2-0392-4922-bc89-73925c0cb4be tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:14.550279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70592e2-0392-4922-bc89-73925c0cb4be tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:14.552315 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70592e2-0392-4922-bc89-73925c0cb4be tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:14.554079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70592e2-0392-4922-bc89-73925c0cb4be tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:14.554539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70592e2-0392-4922-bc89-73925c0cb4be tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:14.554976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70592e2-0392-4922-bc89-73925c0cb4be tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:14.725390 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c70592e2-0392-4922-bc89-73925c0cb4be tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:14.735652 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c70592e2-0392-4922-bc89-73925c0cb4be tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.204772 Aug 10 17:00:14.737131 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 383/779] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:14 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:14.874496 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-ae113fd4-db78-473b-b804-ef407c47a6fb req-7bd646a8-bd61-458f-8ef7-4d2e39f8ce2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e4f0e3-d478-4828-b569-74b375839bf6", "name": "network-vif-deleted", "tag": "58a6c42f-3908-40df-96bd-f071dc3f136d"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:00:14.885806 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ae113fd4-db78-473b-b804-ef407c47a6fb req-7bd646a8-bd61-458f-8ef7-4d2e39f8ce2a service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:14.886220 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ae113fd4-db78-473b-b804-ef407c47a6fb req-7bd646a8-bd61-458f-8ef7-4d2e39f8ce2a service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:14.886638 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ae113fd4-db78-473b-b804-ef407c47a6fb req-7bd646a8-bd61-458f-8ef7-4d2e39f8ce2a service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:14.897998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-ae113fd4-db78-473b-b804-ef407c47a6fb req-7bd646a8-bd61-458f-8ef7-4d2e39f8ce2a service nova] Creating event network-vif-deleted:58a6c42f-3908-40df-96bd-f071dc3f136d for instance f9e4f0e3-d478-4828-b569-74b375839bf6 on hv-cinder-83602 Aug 10 17:00:14.903127 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-ae113fd4-db78-473b-b804-ef407c47a6fb req-7bd646a8-bd61-458f-8ef7-4d2e39f8ce2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033129 Aug 10 17:00:14.903701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 397/780] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:00:15.222714 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:15.223965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:15.234562 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:15.236113 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:15.236901 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:15.238151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:15.239110 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:15.239965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:15.417193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-17c40708-f668-444c-b358-233bca0dfad1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:15.417193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-17c40708-f668-444c-b358-233bca0dfad1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:15.417976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:15.420092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-17c40708-f668-444c-b358-233bca0dfad1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:15.432050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:15.433660 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:15.434921 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a16b989e-8634-42dd-8771-a726d6143cfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.216090 Aug 10 17:00:15.435475 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 384/781] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:15 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:15.438433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-17c40708-f668-444c-b358-233bca0dfad1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:15.438433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-17c40708-f668-444c-b358-233bca0dfad1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:15.438433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-17c40708-f668-444c-b358-233bca0dfad1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:15.438433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-17c40708-f668-444c-b358-233bca0dfad1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:15.441200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-17c40708-f668-444c-b358-233bca0dfad1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:15.502879 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eccc4f4a-b95a-46b2-aae2-a7adf3aabc21 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:15.503642 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eccc4f4a-b95a-46b2-aae2-a7adf3aabc21 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:15.510682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-17c40708-f668-444c-b358-233bca0dfad1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:15.515751 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccc4f4a-b95a-46b2-aae2-a7adf3aabc21 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:15.516503 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccc4f4a-b95a-46b2-aae2-a7adf3aabc21 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:15.517121 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccc4f4a-b95a-46b2-aae2-a7adf3aabc21 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:15.517992 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccc4f4a-b95a-46b2-aae2-a7adf3aabc21 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:15.518441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccc4f4a-b95a-46b2-aae2-a7adf3aabc21 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:15.519024 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccc4f4a-b95a-46b2-aae2-a7adf3aabc21 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:15.519277 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-17c40708-f668-444c-b358-233bca0dfad1 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1471 microversion: 2.1 time: 0.118452 Aug 10 17:00:15.520885 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 398/782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:15 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1471 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:15.675140 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-eccc4f4a-b95a-46b2-aae2-a7adf3aabc21 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:15.685718 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eccc4f4a-b95a-46b2-aae2-a7adf3aabc21 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.186597 Aug 10 17:00:15.686727 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 385/783] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:15 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:15.759256 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7d98fdd4-58cd-4136-b01d-d2a04c2abb21 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:15.760278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7d98fdd4-58cd-4136-b01d-d2a04c2abb21 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:15.766393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d98fdd4-58cd-4136-b01d-d2a04c2abb21 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:15.766875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d98fdd4-58cd-4136-b01d-d2a04c2abb21 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:15.767307 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d98fdd4-58cd-4136-b01d-d2a04c2abb21 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:15.767987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d98fdd4-58cd-4136-b01d-d2a04c2abb21 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:15.768482 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d98fdd4-58cd-4136-b01d-d2a04c2abb21 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:15.768905 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d98fdd4-58cd-4136-b01d-d2a04c2abb21 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:15.900336 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7d98fdd4-58cd-4136-b01d-d2a04c2abb21 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:15.908126 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7d98fdd4-58cd-4136-b01d-d2a04c2abb21 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.152848 Aug 10 17:00:15.908698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 399/784] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:15 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:16.459863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:16.460713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:16.470508 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:16.474965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:16.480752 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:16.481546 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:16.482026 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:16.482463 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:16.542305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-24af2315-af13-4403-a321-489af6b4f4ba tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:16.542912 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-24af2315-af13-4403-a321-489af6b4f4ba tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:16.552383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24af2315-af13-4403-a321-489af6b4f4ba tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:16.553203 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24af2315-af13-4403-a321-489af6b4f4ba tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:16.553846 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24af2315-af13-4403-a321-489af6b4f4ba tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:16.554562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24af2315-af13-4403-a321-489af6b4f4ba tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:16.555015 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24af2315-af13-4403-a321-489af6b4f4ba tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:16.555599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24af2315-af13-4403-a321-489af6b4f4ba tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:16.684245 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-24af2315-af13-4403-a321-489af6b4f4ba tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409b789be2d9402885b2498435c76286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1a38abca5848b78518b882982fc1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:16.691812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-24af2315-af13-4403-a321-489af6b4f4ba tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 200 len: 1471 microversion: 2.1 time: 0.153392 Aug 10 17:00:16.698401 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:16.701651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 400/785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:16 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:16.712263 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:16.713410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-671d66ba-0cb0-42c3-aea7-1f7690510132 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:16.714256 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:16.716990 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-671d66ba-0cb0-42c3-aea7-1f7690510132 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:16.717430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6bc70adf-4cd1-4b9a-91a5-0fe8f6db6dd5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.261986 Aug 10 17:00:16.732179 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 386/786] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:16 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:16.732405 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-671d66ba-0cb0-42c3-aea7-1f7690510132 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:16.732405 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-671d66ba-0cb0-42c3-aea7-1f7690510132 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:16.732405 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-671d66ba-0cb0-42c3-aea7-1f7690510132 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:16.732405 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-671d66ba-0cb0-42c3-aea7-1f7690510132 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:16.732725 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-671d66ba-0cb0-42c3-aea7-1f7690510132 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:16.736223 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-671d66ba-0cb0-42c3-aea7-1f7690510132 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:16.739433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:16.905463 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-671d66ba-0cb0-42c3-aea7-1f7690510132 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:16.913824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-671d66ba-0cb0-42c3-aea7-1f7690510132 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.208325 Aug 10 17:00:16.914572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 401/787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:16 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:17.060825 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1a026879-fb76-4b91-82ae-e1d74c3ab882 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:17.061672 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1a026879-fb76-4b91-82ae-e1d74c3ab882 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:17.071878 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a026879-fb76-4b91-82ae-e1d74c3ab882 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:17.072487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a026879-fb76-4b91-82ae-e1d74c3ab882 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:17.072923 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a026879-fb76-4b91-82ae-e1d74c3ab882 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:17.073621 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a026879-fb76-4b91-82ae-e1d74c3ab882 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:17.074099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a026879-fb76-4b91-82ae-e1d74c3ab882 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:17.074589 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a026879-fb76-4b91-82ae-e1d74c3ab882 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:17.227437 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1a026879-fb76-4b91-82ae-e1d74c3ab882 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:17.235751 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1a026879-fb76-4b91-82ae-e1d74c3ab882 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.306117 Aug 10 17:00:17.244126 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 387/788] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:16 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:17.714516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:17.715157 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] [instance: f9e4f0e3-d478-4828-b569-74b375839bf6] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:17.724479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:17.725219 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:17.725857 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:17.726748 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:17.727469 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:17.728051 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:17.743315 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] HTTP exception thrown: Instance f9e4f0e3-d478-4828-b569-74b375839bf6 could not be found. Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Request method failure captured: Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 HTTP/1.1 Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-NSxCUjy1TwklpT1SvY5-4rsCt9SeDXMYHPcdsedwfHu2FhgpqFDCc4OeKcGWQNR-NCXtZIxX7i45yog_eLOOIgCAne9ZQkywYnerSLujmflfGYNn_ki6tHkxaqCD3sJlfIvHiywgimXK4rx5LKM6Fw-vHP1Ggt4E_8A6Aw4Q7EaPU Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: aa1a38abca5848b78518b882982fc1be Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesSnapshotTestJSON-733366104 Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:00:17.744987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aa1a38abca5848b78518b882982fc1be", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa1a38abca5848b78518b882982fc1be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa1a38abca5848b78518b882982fc1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aa1a38abca5848b78518b882982fc1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesSnapshotTestJSON-733366104 Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: aa1a38abca5848b78518b882982fc1be Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-733366104 Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesSnapshotTestJSON-733366104-project Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 409b789be2d9402885b2498435c76286 Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesSnapshotTestJSON-733366104-project Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance f9e4f0e3-d478-4828-b569-74b375839bf6 could not be found. Aug 10 17:00:17.746531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'f9e4f0e3-d478-4828-b569-74b375839bf6'} Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e4f0e3-d478-4828-b569-74b375839bf6 could not be found. Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:00:17.747449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e4f0e3-d478-4828-b569-74b375839bf6 could not be found. Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e4f0e3-d478-4828-b569-74b375839bf6 could not be found. Aug 10 17:00:17.748980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:00:17.751072 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] Returning 404 to user: Instance f9e4f0e3-d478-4828-b569-74b375839bf6 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:00:17.751433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:17.752044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:17.752802 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ae15a2ce-ad79-4772-ba43-37f407d565a0 tempest-VolumesSnapshotTestJSON-733366104 tempest-VolumesSnapshotTestJSON-733366104-project] 10.222.0.25 "GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6" status: 404 len: 111 microversion: 2.1 time: 0.042279 Aug 10 17:00:17.753518 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 402/789] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:17 2022] GET /compute/v2.1/servers/f9e4f0e3-d478-4828-b569-74b375839bf6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:00:17.768258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:17.768258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:17.768258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:17.768258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:17.768875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:17.768875 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:17.936246 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e220dbc4-24d9-4995-b704-5ac0d1f1116a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:17.937240 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e220dbc4-24d9-4995-b704-5ac0d1f1116a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:17.948168 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e220dbc4-24d9-4995-b704-5ac0d1f1116a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:17.948972 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e220dbc4-24d9-4995-b704-5ac0d1f1116a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:17.949623 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e220dbc4-24d9-4995-b704-5ac0d1f1116a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:17.951659 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e220dbc4-24d9-4995-b704-5ac0d1f1116a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:17.952733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e220dbc4-24d9-4995-b704-5ac0d1f1116a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:17.955472 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e220dbc4-24d9-4995-b704-5ac0d1f1116a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:18.028432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:18.038261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:18.048167 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:18.059090 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-44c3bd51-8bad-4709-a33f-61aae8d81ddd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.311494 Aug 10 17:00:18.059758 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 388/790] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:17 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:18.218521 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e220dbc4-24d9-4995-b704-5ac0d1f1116a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:18.229476 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e220dbc4-24d9-4995-b704-5ac0d1f1116a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.296614 Aug 10 17:00:18.243502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 403/791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:17 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:18.257929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f0bb13b1-c6a7-4038-b4ad-f58887c5bd7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:18.258620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f0bb13b1-c6a7-4038-b4ad-f58887c5bd7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:18.264749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0bb13b1-c6a7-4038-b4ad-f58887c5bd7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:18.265546 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0bb13b1-c6a7-4038-b4ad-f58887c5bd7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:18.266225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0bb13b1-c6a7-4038-b4ad-f58887c5bd7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:18.267184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0bb13b1-c6a7-4038-b4ad-f58887c5bd7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:18.267928 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0bb13b1-c6a7-4038-b4ad-f58887c5bd7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:18.268475 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0bb13b1-c6a7-4038-b4ad-f58887c5bd7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:18.423894 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f0bb13b1-c6a7-4038-b4ad-f58887c5bd7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:18.432910 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f0bb13b1-c6a7-4038-b4ad-f58887c5bd7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.178421 Aug 10 17:00:18.447016 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 389/792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:18 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:19.084740 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:19.086830 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:19.094527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:19.095135 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:19.095628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:19.096428 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:19.097093 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:19.097639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:19.240568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:19.248961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:19.257423 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7036bf4-f34e-4f29-bab8-04e1da8129da tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:19.258566 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f7036bf4-f34e-4f29-bab8-04e1da8129da tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:19.259896 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:19.262815 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9729a933-87aa-40e4-91a4-1d67118abc6e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.182239 Aug 10 17:00:19.266200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 404/793] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:19 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:19.267986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7036bf4-f34e-4f29-bab8-04e1da8129da tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:19.269290 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7036bf4-f34e-4f29-bab8-04e1da8129da tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:19.270505 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7036bf4-f34e-4f29-bab8-04e1da8129da tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:19.271710 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7036bf4-f34e-4f29-bab8-04e1da8129da tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:19.272405 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7036bf4-f34e-4f29-bab8-04e1da8129da tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:19.273025 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7036bf4-f34e-4f29-bab8-04e1da8129da tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:19.437823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f7036bf4-f34e-4f29-bab8-04e1da8129da tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:19.446290 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7036bf4-f34e-4f29-bab8-04e1da8129da tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.195260 Aug 10 17:00:19.454327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8163f41c-f2fa-439b-b70f-6426b083693a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:19.455024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8163f41c-f2fa-439b-b70f-6426b083693a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:19.462856 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 390/794] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:19 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:19.472184 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8163f41c-f2fa-439b-b70f-6426b083693a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:19.473019 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8163f41c-f2fa-439b-b70f-6426b083693a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:19.474080 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8163f41c-f2fa-439b-b70f-6426b083693a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:19.475052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8163f41c-f2fa-439b-b70f-6426b083693a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:19.475595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8163f41c-f2fa-439b-b70f-6426b083693a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:19.476102 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8163f41c-f2fa-439b-b70f-6426b083693a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:19.623608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8163f41c-f2fa-439b-b70f-6426b083693a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:19.637303 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8163f41c-f2fa-439b-b70f-6426b083693a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.187157 Aug 10 17:00:19.637877 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 405/795] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:19 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:20.291735 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:20.292381 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:20.300352 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:20.301930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:20.302591 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:20.303521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:20.304125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:20.304721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:20.474261 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-27fc73c6-ecba-4c1a-8099-c81d953cb7cb tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:20.475712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-27fc73c6-ecba-4c1a-8099-c81d953cb7cb tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:20.486202 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fc73c6-ecba-4c1a-8099-c81d953cb7cb tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:20.488300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fc73c6-ecba-4c1a-8099-c81d953cb7cb tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:20.489939 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fc73c6-ecba-4c1a-8099-c81d953cb7cb tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:20.490713 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fc73c6-ecba-4c1a-8099-c81d953cb7cb tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:20.491430 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fc73c6-ecba-4c1a-8099-c81d953cb7cb tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:20.491965 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27fc73c6-ecba-4c1a-8099-c81d953cb7cb tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:20.527464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:20.537825 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:20.539345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:20.540550 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-91ad79cd-dc5c-400f-b90d-6c02e4881163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.253067 Aug 10 17:00:20.543992 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 391/796] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:20 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:20.660074 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-182fa040-1f65-40c1-aba8-faaad3d9f151 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:20.661587 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-182fa040-1f65-40c1-aba8-faaad3d9f151 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:20.668344 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-182fa040-1f65-40c1-aba8-faaad3d9f151 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:20.669234 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-182fa040-1f65-40c1-aba8-faaad3d9f151 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:20.669745 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-182fa040-1f65-40c1-aba8-faaad3d9f151 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:20.670585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-182fa040-1f65-40c1-aba8-faaad3d9f151 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:20.672982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-182fa040-1f65-40c1-aba8-faaad3d9f151 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:20.672982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-182fa040-1f65-40c1-aba8-faaad3d9f151 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:20.687424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-27fc73c6-ecba-4c1a-8099-c81d953cb7cb tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:20.698524 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-27fc73c6-ecba-4c1a-8099-c81d953cb7cb tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.231344 Aug 10 17:00:20.700044 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 406/797] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:20 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:20.817155 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-182fa040-1f65-40c1-aba8-faaad3d9f151 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:20.826836 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-182fa040-1f65-40c1-aba8-faaad3d9f151 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.172219 Aug 10 17:00:20.827402 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 392/798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:20 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:21.564320 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:21.565523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:21.573187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:21.573813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:21.574435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:21.575192 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:21.575627 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:21.576115 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:21.722544 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6e2c31dd-3043-4422-ab76-c000683b8589 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:21.723934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6e2c31dd-3043-4422-ab76-c000683b8589 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:21.737225 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:21.737516 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e2c31dd-3043-4422-ab76-c000683b8589 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:21.738348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e2c31dd-3043-4422-ab76-c000683b8589 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:21.738894 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e2c31dd-3043-4422-ab76-c000683b8589 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:21.739955 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e2c31dd-3043-4422-ab76-c000683b8589 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:21.744731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e2c31dd-3043-4422-ab76-c000683b8589 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:21.745185 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e2c31dd-3043-4422-ab76-c000683b8589 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:21.746993 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:21.748657 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:21.749980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5b4a11c7-8672-472c-8b91-4fae197755be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.190902 Aug 10 17:00:21.751219 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 407/799] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:21 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:21.849849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1c290fa1-0a7b-4ac0-8855-a3878ce5407f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:21.850744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1c290fa1-0a7b-4ac0-8855-a3878ce5407f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:21.857370 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c290fa1-0a7b-4ac0-8855-a3878ce5407f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:21.858503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c290fa1-0a7b-4ac0-8855-a3878ce5407f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:21.858960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c290fa1-0a7b-4ac0-8855-a3878ce5407f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:21.860255 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c290fa1-0a7b-4ac0-8855-a3878ce5407f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:21.860728 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c290fa1-0a7b-4ac0-8855-a3878ce5407f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:21.864626 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c290fa1-0a7b-4ac0-8855-a3878ce5407f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:21.897430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6e2c31dd-3043-4422-ab76-c000683b8589 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:21.905860 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6e2c31dd-3043-4422-ab76-c000683b8589 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.189016 Aug 10 17:00:21.906773 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 393/800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:21 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:22.031406 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1c290fa1-0a7b-4ac0-8855-a3878ce5407f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:22.041390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1c290fa1-0a7b-4ac0-8855-a3878ce5407f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.196485 Aug 10 17:00:22.055279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 408/801] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:21 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:22.781455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:22.782105 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:22.788792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:22.789306 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:22.789956 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:22.790828 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:22.791276 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:22.791698 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:22.927774 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4db0c6d5-47fe-423a-8ee3-b2e40e08afbd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:22.928426 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4db0c6d5-47fe-423a-8ee3-b2e40e08afbd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:22.935284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4db0c6d5-47fe-423a-8ee3-b2e40e08afbd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:22.936323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4db0c6d5-47fe-423a-8ee3-b2e40e08afbd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:22.937006 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4db0c6d5-47fe-423a-8ee3-b2e40e08afbd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:22.937979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4db0c6d5-47fe-423a-8ee3-b2e40e08afbd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:22.938695 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4db0c6d5-47fe-423a-8ee3-b2e40e08afbd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:22.939309 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:22.939572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4db0c6d5-47fe-423a-8ee3-b2e40e08afbd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:22.950413 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:22.951901 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:22.953317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-82d633f6-ccd4-40b8-bc37-c5bf2fd2dddc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.178211 Aug 10 17:00:22.971319 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 394/802] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:22 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:00:23.062463 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e4ab0dc-b2c0-47c6-b65e-8a9c91b5176c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:23.063412 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2e4ab0dc-b2c0-47c6-b65e-8a9c91b5176c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:23.076397 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0dc-b2c0-47c6-b65e-8a9c91b5176c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:23.077306 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0dc-b2c0-47c6-b65e-8a9c91b5176c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:23.078035 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0dc-b2c0-47c6-b65e-8a9c91b5176c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:23.079316 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0dc-b2c0-47c6-b65e-8a9c91b5176c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:23.079946 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0dc-b2c0-47c6-b65e-8a9c91b5176c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:23.080632 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e4ab0dc-b2c0-47c6-b65e-8a9c91b5176c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:23.128685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4db0c6d5-47fe-423a-8ee3-b2e40e08afbd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:23.140491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4db0c6d5-47fe-423a-8ee3-b2e40e08afbd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.217257 Aug 10 17:00:23.141392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 409/803] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:22 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:23.235045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2e4ab0dc-b2c0-47c6-b65e-8a9c91b5176c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:23.244535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2e4ab0dc-b2c0-47c6-b65e-8a9c91b5176c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.185805 Aug 10 17:00:23.247399 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 395/804] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:23 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:23.977533 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:23.978068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:23.985059 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:23.985797 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:23.986399 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:23.987114 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:23.987713 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:23.988175 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:24.131878 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:24.140793 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:24.142331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:24.143489 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-44ca4925-7060-4650-9d63-a9f5e5c4c901 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.170575 Aug 10 17:00:24.144040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 410/805] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:23 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:24.161536 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-110ab1f6-5611-4bec-b637-b7b574d3cc99 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:24.162779 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-110ab1f6-5611-4bec-b637-b7b574d3cc99 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:24.169578 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-110ab1f6-5611-4bec-b637-b7b574d3cc99 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:24.170197 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-110ab1f6-5611-4bec-b637-b7b574d3cc99 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:24.170638 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-110ab1f6-5611-4bec-b637-b7b574d3cc99 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:24.171535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-110ab1f6-5611-4bec-b637-b7b574d3cc99 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:24.171996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-110ab1f6-5611-4bec-b637-b7b574d3cc99 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:24.172459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-110ab1f6-5611-4bec-b637-b7b574d3cc99 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:24.266809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5b93f672-dee2-4d9f-aad9-87148fa4c461 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:24.268032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5b93f672-dee2-4d9f-aad9-87148fa4c461 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:24.278450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b93f672-dee2-4d9f-aad9-87148fa4c461 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:24.279445 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b93f672-dee2-4d9f-aad9-87148fa4c461 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:24.279861 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b93f672-dee2-4d9f-aad9-87148fa4c461 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:24.280618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b93f672-dee2-4d9f-aad9-87148fa4c461 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:24.281071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b93f672-dee2-4d9f-aad9-87148fa4c461 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:24.284450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b93f672-dee2-4d9f-aad9-87148fa4c461 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:24.371513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-110ab1f6-5611-4bec-b637-b7b574d3cc99 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:24.388421 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-110ab1f6-5611-4bec-b637-b7b574d3cc99 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.231087 Aug 10 17:00:24.389131 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 396/806] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:24 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:24.466506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5b93f672-dee2-4d9f-aad9-87148fa4c461 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:24.475767 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5b93f672-dee2-4d9f-aad9-87148fa4c461 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.212626 Aug 10 17:00:24.476697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 411/807] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:24 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:24.494061 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b6aee1ee-d872-42fc-baf9-e647e7ce39d2 req-b8608f20-d568-4065-a205-3c7bf4c2e3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6995ac7-abff-47f3-a48c-a24fc437717e", "name": "network-vif-plugged", "status": "completed", "tag": "e581d1b5-c12c-49b1-91c7-4fddf08829ab"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:00:24.506050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b6aee1ee-d872-42fc-baf9-e647e7ce39d2 req-b8608f20-d568-4065-a205-3c7bf4c2e3a2 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:24.507191 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b6aee1ee-d872-42fc-baf9-e647e7ce39d2 req-b8608f20-d568-4065-a205-3c7bf4c2e3a2 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:24.507699 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b6aee1ee-d872-42fc-baf9-e647e7ce39d2 req-b8608f20-d568-4065-a205-3c7bf4c2e3a2 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:24.520662 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b6aee1ee-d872-42fc-baf9-e647e7ce39d2 req-b8608f20-d568-4065-a205-3c7bf4c2e3a2 service nova] Creating event network-vif-plugged:e581d1b5-c12c-49b1-91c7-4fddf08829ab for instance f6995ac7-abff-47f3-a48c-a24fc437717e on hv-cinder-83602 Aug 10 17:00:24.527121 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b6aee1ee-d872-42fc-baf9-e647e7ce39d2 req-b8608f20-d568-4065-a205-3c7bf4c2e3a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036958 Aug 10 17:00:24.527972 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 397/808] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:00:25.168350 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:25.168959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:25.175306 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:25.176315 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:25.176752 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:25.177439 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:25.177892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:25.178313 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:25.312425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:25.320861 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:25.322339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:25.323471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c38b1de4-da8a-4d03-b670-36965146dc49 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.159096 Aug 10 17:00:25.324015 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 412/809] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:25 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:25.410786 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9581543c-75d6-4b07-8bf8-0c310cc8e8ea tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:25.411501 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9581543c-75d6-4b07-8bf8-0c310cc8e8ea tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:25.417846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9581543c-75d6-4b07-8bf8-0c310cc8e8ea tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:25.418369 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9581543c-75d6-4b07-8bf8-0c310cc8e8ea tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:25.418811 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9581543c-75d6-4b07-8bf8-0c310cc8e8ea tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:25.419511 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9581543c-75d6-4b07-8bf8-0c310cc8e8ea tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:25.419969 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9581543c-75d6-4b07-8bf8-0c310cc8e8ea tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:25.420424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9581543c-75d6-4b07-8bf8-0c310cc8e8ea tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:25.437106 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:25.499226 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c1aa5ea3-acb7-4377-b4b5-71941bdd70a5 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:25.499842 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c1aa5ea3-acb7-4377-b4b5-71941bdd70a5 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:25.506257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1aa5ea3-acb7-4377-b4b5-71941bdd70a5 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:25.506746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1aa5ea3-acb7-4377-b4b5-71941bdd70a5 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:25.507181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1aa5ea3-acb7-4377-b4b5-71941bdd70a5 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:25.507895 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1aa5ea3-acb7-4377-b4b5-71941bdd70a5 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:25.508378 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1aa5ea3-acb7-4377-b4b5-71941bdd70a5 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:25.508806 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c1aa5ea3-acb7-4377-b4b5-71941bdd70a5 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:25.557809 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9581543c-75d6-4b07-8bf8-0c310cc8e8ea tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:25.565434 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9581543c-75d6-4b07-8bf8-0c310cc8e8ea tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.159734 Aug 10 17:00:25.565949 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 398/810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:25 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:25.636648 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c1aa5ea3-acb7-4377-b4b5-71941bdd70a5 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:25.644437 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c1aa5ea3-acb7-4377-b4b5-71941bdd70a5 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.148980 Aug 10 17:00:25.645606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 413/811] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:25 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:26.345428 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:26.346029 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:26.351867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:26.352390 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:26.352824 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:26.353504 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:26.353953 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:26.354372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:26.481088 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:26.489860 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:26.491361 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:26.492544 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08723d5c-1335-4776-8219-f9051cde8f58 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.151062 Aug 10 17:00:26.493228 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 399/812] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:26 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:26.586624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2cb05b24-37da-496c-806f-eb4aa205e09d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:26.587234 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2cb05b24-37da-496c-806f-eb4aa205e09d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:26.593589 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cb05b24-37da-496c-806f-eb4aa205e09d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:26.594075 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cb05b24-37da-496c-806f-eb4aa205e09d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:26.594511 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cb05b24-37da-496c-806f-eb4aa205e09d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:26.595196 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cb05b24-37da-496c-806f-eb4aa205e09d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:26.595700 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cb05b24-37da-496c-806f-eb4aa205e09d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:26.596068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cb05b24-37da-496c-806f-eb4aa205e09d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:26.666872 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d97c98f1-c3aa-41dd-b6a1-3ce847e67020 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:26.667483 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d97c98f1-c3aa-41dd-b6a1-3ce847e67020 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:26.673431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d97c98f1-c3aa-41dd-b6a1-3ce847e67020 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:26.674105 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d97c98f1-c3aa-41dd-b6a1-3ce847e67020 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:26.674376 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d97c98f1-c3aa-41dd-b6a1-3ce847e67020 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:26.675083 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d97c98f1-c3aa-41dd-b6a1-3ce847e67020 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:26.675540 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d97c98f1-c3aa-41dd-b6a1-3ce847e67020 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:26.676475 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d97c98f1-c3aa-41dd-b6a1-3ce847e67020 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:26.729830 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2cb05b24-37da-496c-806f-eb4aa205e09d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:26.739805 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2cb05b24-37da-496c-806f-eb4aa205e09d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.156799 Aug 10 17:00:26.741098 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 414/813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:26 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:26.817475 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d97c98f1-c3aa-41dd-b6a1-3ce847e67020 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:26.825531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d97c98f1-c3aa-41dd-b6a1-3ce847e67020 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.162526 Aug 10 17:00:26.826091 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 400/814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:26 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:27.514999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:27.515609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:27.522175 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:27.522648 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:27.523126 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:27.523957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:27.524440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:27.524856 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:27.654796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:27.662530 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:27.664005 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:27.665218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-460235c9-3013-49df-bf1c-170ff5513869 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.154040 Aug 10 17:00:27.665721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 415/815] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:27 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:27.763562 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7ea5478b-1978-468d-ba40-35e3b7bb6442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:27.764194 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7ea5478b-1978-468d-ba40-35e3b7bb6442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:27.771485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ea5478b-1978-468d-ba40-35e3b7bb6442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:27.771972 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ea5478b-1978-468d-ba40-35e3b7bb6442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:27.772434 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ea5478b-1978-468d-ba40-35e3b7bb6442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:27.773127 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ea5478b-1978-468d-ba40-35e3b7bb6442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:27.773589 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ea5478b-1978-468d-ba40-35e3b7bb6442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:27.774033 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ea5478b-1978-468d-ba40-35e3b7bb6442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:27.847468 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bc590c3f-742a-4b4a-8ada-e334ba09e4de tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:27.848361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bc590c3f-742a-4b4a-8ada-e334ba09e4de tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:27.859640 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc590c3f-742a-4b4a-8ada-e334ba09e4de tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:27.860365 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc590c3f-742a-4b4a-8ada-e334ba09e4de tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:27.860798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc590c3f-742a-4b4a-8ada-e334ba09e4de tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:27.861565 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc590c3f-742a-4b4a-8ada-e334ba09e4de tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:27.862042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc590c3f-742a-4b4a-8ada-e334ba09e4de tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:27.862750 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc590c3f-742a-4b4a-8ada-e334ba09e4de tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:27.908361 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ea5478b-1978-468d-ba40-35e3b7bb6442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:27.916307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7ea5478b-1978-468d-ba40-35e3b7bb6442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.156702 Aug 10 17:00:27.928398 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 401/816] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:27 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:27.990006 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bc590c3f-742a-4b4a-8ada-e334ba09e4de tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:27.997731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bc590c3f-742a-4b4a-8ada-e334ba09e4de tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.154896 Aug 10 17:00:27.998285 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 416/817] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:27 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:28.687522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:28.688130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:28.694012 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:28.694496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:28.694930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:28.695763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:28.696282 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:28.696729 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:28.821630 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:28.829411 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:28.830904 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:28.832048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-87daab0b-e17f-4ec4-b957-5a775888f032 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.148663 Aug 10 17:00:28.833142 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 402/818] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:28 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:28.936770 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7bccab5a-4f91-4b77-8884-5998831f9a2f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:28.937383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7bccab5a-4f91-4b77-8884-5998831f9a2f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:28.944437 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bccab5a-4f91-4b77-8884-5998831f9a2f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:28.944866 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bccab5a-4f91-4b77-8884-5998831f9a2f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:28.945302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bccab5a-4f91-4b77-8884-5998831f9a2f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:28.945985 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bccab5a-4f91-4b77-8884-5998831f9a2f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:28.946437 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bccab5a-4f91-4b77-8884-5998831f9a2f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:28.946860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bccab5a-4f91-4b77-8884-5998831f9a2f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:29.018747 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3fb0865e-6970-41cf-8a64-cfc1e441461e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:29.019360 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3fb0865e-6970-41cf-8a64-cfc1e441461e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:29.025216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb0865e-6970-41cf-8a64-cfc1e441461e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:29.025706 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb0865e-6970-41cf-8a64-cfc1e441461e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:29.026140 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb0865e-6970-41cf-8a64-cfc1e441461e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:29.026837 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb0865e-6970-41cf-8a64-cfc1e441461e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:29.027292 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb0865e-6970-41cf-8a64-cfc1e441461e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:29.027720 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb0865e-6970-41cf-8a64-cfc1e441461e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:29.081759 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7bccab5a-4f91-4b77-8884-5998831f9a2f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:29.089517 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7bccab5a-4f91-4b77-8884-5998831f9a2f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.156475 Aug 10 17:00:29.090088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 417/819] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:28 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:29.158340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-3fb0865e-6970-41cf-8a64-cfc1e441461e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:29.166741 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3fb0865e-6970-41cf-8a64-cfc1e441461e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.151831 Aug 10 17:00:29.167305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 403/820] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:29 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:29.855511 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:29.856131 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:29.862271 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:29.862750 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:29.863184 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:29.863899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:29.864507 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:29.864927 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:29.880097 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:29.991189 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:29.998989 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:30.000505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:30.001652 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a5d2026f-0f0d-40a0-aa60-7ca53018fbf7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.150002 Aug 10 17:00:30.002204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 418/821] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:29 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:30.110146 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-243b7f73-7f6d-4aea-b760-aee500759a68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:30.110687 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-243b7f73-7f6d-4aea-b760-aee500759a68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:30.116994 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-243b7f73-7f6d-4aea-b760-aee500759a68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:30.117478 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-243b7f73-7f6d-4aea-b760-aee500759a68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:30.117915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-243b7f73-7f6d-4aea-b760-aee500759a68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:30.118603 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-243b7f73-7f6d-4aea-b760-aee500759a68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:30.119058 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-243b7f73-7f6d-4aea-b760-aee500759a68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:30.119487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-243b7f73-7f6d-4aea-b760-aee500759a68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:30.187741 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-85af478e-363e-4d55-8eeb-576c51ee6a7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:30.188452 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-85af478e-363e-4d55-8eeb-576c51ee6a7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:30.194880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85af478e-363e-4d55-8eeb-576c51ee6a7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:30.195462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85af478e-363e-4d55-8eeb-576c51ee6a7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:30.195875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85af478e-363e-4d55-8eeb-576c51ee6a7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:30.196593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85af478e-363e-4d55-8eeb-576c51ee6a7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:30.197043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85af478e-363e-4d55-8eeb-576c51ee6a7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:30.197460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85af478e-363e-4d55-8eeb-576c51ee6a7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:30.249266 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-243b7f73-7f6d-4aea-b760-aee500759a68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:30.257377 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-243b7f73-7f6d-4aea-b760-aee500759a68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.151083 Aug 10 17:00:30.257956 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 404/822] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:30 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:30.327025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-85af478e-363e-4d55-8eeb-576c51ee6a7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:30.335383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-85af478e-363e-4d55-8eeb-576c51ee6a7b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.151449 Aug 10 17:00:30.335938 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 419/823] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:30 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:31.025089 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:31.025698 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:31.031482 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:31.031966 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:31.032430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:31.033125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:31.033578 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:31.034006 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:31.181295 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:31.189214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:31.190722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:31.191878 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-50f16932-8507-478b-ae6a-dfb9712282c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1739 microversion: 2.20 time: 0.170732 Aug 10 17:00:31.192469 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 405/824] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:31 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:00:31.277902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bfd3e5be-999e-449f-9577-16c6e70b74a5 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:31.278508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bfd3e5be-999e-449f-9577-16c6e70b74a5 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:31.284804 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfd3e5be-999e-449f-9577-16c6e70b74a5 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:31.285961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfd3e5be-999e-449f-9577-16c6e70b74a5 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:31.286386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfd3e5be-999e-449f-9577-16c6e70b74a5 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:31.287067 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfd3e5be-999e-449f-9577-16c6e70b74a5 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:31.287521 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfd3e5be-999e-449f-9577-16c6e70b74a5 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:31.287938 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfd3e5be-999e-449f-9577-16c6e70b74a5 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:31.355873 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-83177790-6b36-477f-9e47-212564bf7eca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:31.356562 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-83177790-6b36-477f-9e47-212564bf7eca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:31.362452 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83177790-6b36-477f-9e47-212564bf7eca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:31.363023 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83177790-6b36-477f-9e47-212564bf7eca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:31.363536 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83177790-6b36-477f-9e47-212564bf7eca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:31.364344 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83177790-6b36-477f-9e47-212564bf7eca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:31.364879 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83177790-6b36-477f-9e47-212564bf7eca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:31.365402 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83177790-6b36-477f-9e47-212564bf7eca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:31.423495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bfd3e5be-999e-449f-9577-16c6e70b74a5 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:31.431149 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bfd3e5be-999e-449f-9577-16c6e70b74a5 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.157027 Aug 10 17:00:31.431718 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 420/825] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:31 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:31.506500 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-83177790-6b36-477f-9e47-212564bf7eca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:31.514268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-83177790-6b36-477f-9e47-212564bf7eca tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.162437 Aug 10 17:00:31.514832 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 406/826] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:31 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:32.214712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:32.215364 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:32.222212 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:32.223327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:32.223838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:32.224562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:32.225008 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:32.225453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:32.362874 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:32.371981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:32.373508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:32.374652 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7af7afbc-3201-4941-ab88-e83ad36cf3e2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1721 microversion: 2.20 time: 0.163971 Aug 10 17:00:32.375205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 421/827] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:32 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:00:32.453338 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19d1676b-329b-44f8-b19a-b69cf24a30f7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:32.454005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-19d1676b-329b-44f8-b19a-b69cf24a30f7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:32.461079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d1676b-329b-44f8-b19a-b69cf24a30f7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:32.461561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d1676b-329b-44f8-b19a-b69cf24a30f7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:32.462001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d1676b-329b-44f8-b19a-b69cf24a30f7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:32.462688 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d1676b-329b-44f8-b19a-b69cf24a30f7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:32.463146 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d1676b-329b-44f8-b19a-b69cf24a30f7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:32.463570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d1676b-329b-44f8-b19a-b69cf24a30f7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:32.536673 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7081e430-c640-4db2-ba6f-3b07b5ccef78 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:32.537361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7081e430-c640-4db2-ba6f-3b07b5ccef78 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:32.543138 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7081e430-c640-4db2-ba6f-3b07b5ccef78 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:32.543621 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7081e430-c640-4db2-ba6f-3b07b5ccef78 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:32.544048 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7081e430-c640-4db2-ba6f-3b07b5ccef78 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:32.544762 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7081e430-c640-4db2-ba6f-3b07b5ccef78 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:32.545210 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7081e430-c640-4db2-ba6f-3b07b5ccef78 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:32.545625 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7081e430-c640-4db2-ba6f-3b07b5ccef78 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:32.593275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-19d1676b-329b-44f8-b19a-b69cf24a30f7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:32.601362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19d1676b-329b-44f8-b19a-b69cf24a30f7 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.152038 Aug 10 17:00:32.601927 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 407/828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:32 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:32.677165 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7081e430-c640-4db2-ba6f-3b07b5ccef78 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:32.685055 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7081e430-c640-4db2-ba6f-3b07b5ccef78 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1724 microversion: 2.1 time: 0.152901 Aug 10 17:00:32.685617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 422/829] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:32 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:33.397255 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:33.397887 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:33.403893 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:33.404413 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:33.404853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:33.405546 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:33.406009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:33.406439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:33.540516 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:33.548555 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:33.549999 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:33.551646 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-01eb067e-8d2f-4a16-9f75-de826e43b500 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1721 microversion: 2.20 time: 0.158319 Aug 10 17:00:33.552229 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 408/830] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:33 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:00:33.621553 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3c5f4760-54a2-4bac-9c6b-c9e5ab35378e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:33.622161 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3c5f4760-54a2-4bac-9c6b-c9e5ab35378e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:33.628568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5f4760-54a2-4bac-9c6b-c9e5ab35378e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:33.629047 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5f4760-54a2-4bac-9c6b-c9e5ab35378e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:33.629478 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5f4760-54a2-4bac-9c6b-c9e5ab35378e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:33.630159 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5f4760-54a2-4bac-9c6b-c9e5ab35378e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:33.630608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5f4760-54a2-4bac-9c6b-c9e5ab35378e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:33.631029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5f4760-54a2-4bac-9c6b-c9e5ab35378e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:33.705414 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd04b9bb-9310-4320-aeb7-be10a1069a0b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:33.706031 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dd04b9bb-9310-4320-aeb7-be10a1069a0b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:33.712447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd04b9bb-9310-4320-aeb7-be10a1069a0b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:33.712925 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd04b9bb-9310-4320-aeb7-be10a1069a0b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:33.713370 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd04b9bb-9310-4320-aeb7-be10a1069a0b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:33.714107 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd04b9bb-9310-4320-aeb7-be10a1069a0b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:33.714570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd04b9bb-9310-4320-aeb7-be10a1069a0b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:33.715003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd04b9bb-9310-4320-aeb7-be10a1069a0b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:33.815000 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3c5f4760-54a2-4bac-9c6b-c9e5ab35378e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:33.823058 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3c5f4760-54a2-4bac-9c6b-c9e5ab35378e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1266 microversion: 2.1 time: 0.205282 Aug 10 17:00:33.823848 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 423/831] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:33 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:33.850588 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd04b9bb-9310-4320-aeb7-be10a1069a0b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:33.858559 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd04b9bb-9310-4320-aeb7-be10a1069a0b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1701 microversion: 2.1 time: 0.156966 Aug 10 17:00:33.859128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 409/832] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:33 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:33.879747 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a7d64344-3f35-4421-b13e-81136e6cd53c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:00:33.885605 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7d64344-3f35-4421-b13e-81136e6cd53c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:33.886091 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7d64344-3f35-4421-b13e-81136e6cd53c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:33.886535 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7d64344-3f35-4421-b13e-81136e6cd53c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:33.952477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a7d64344-3f35-4421-b13e-81136e6cd53c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Going to try to start instance {{(pid=120608) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 17:00:33.999912 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a7d64344-3f35-4421-b13e-81136e6cd53c tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "POST /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/action" status: 202 len: 0 microversion: 2.1 time: 0.123762 Aug 10 17:00:34.000547 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 424/833] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 17:00:33 2022] POST /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:00:34.008526 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c4d2648c-ffe3-4a88-bf6a-cc52b2fbd22a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:34.009137 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c4d2648c-ffe3-4a88-bf6a-cc52b2fbd22a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:34.014913 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d2648c-ffe3-4a88-bf6a-cc52b2fbd22a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:34.015404 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d2648c-ffe3-4a88-bf6a-cc52b2fbd22a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:34.015858 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d2648c-ffe3-4a88-bf6a-cc52b2fbd22a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:34.016565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d2648c-ffe3-4a88-bf6a-cc52b2fbd22a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:34.017020 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d2648c-ffe3-4a88-bf6a-cc52b2fbd22a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:34.017447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d2648c-ffe3-4a88-bf6a-cc52b2fbd22a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:34.149909 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c4d2648c-ffe3-4a88-bf6a-cc52b2fbd22a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:34.157715 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c4d2648c-ffe3-4a88-bf6a-cc52b2fbd22a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1710 microversion: 2.1 time: 0.152964 Aug 10 17:00:34.158277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 410/834] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:34 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:34.477382 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-00959b04-3579-47d4-a86d-3b2e648722fc req-4a179751-62ac-4a83-a228-6e5ac041c68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c45104f-0ee5-4fec-92ad-7937cbe53805", "name": "network-vif-unplugged", "status": "completed", "tag": "da10f762-bc62-4992-aee6-1b182938963c"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:00:34.487278 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-00959b04-3579-47d4-a86d-3b2e648722fc req-4a179751-62ac-4a83-a228-6e5ac041c68f service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:34.487819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-00959b04-3579-47d4-a86d-3b2e648722fc req-4a179751-62ac-4a83-a228-6e5ac041c68f service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:34.488344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-00959b04-3579-47d4-a86d-3b2e648722fc req-4a179751-62ac-4a83-a228-6e5ac041c68f service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:34.499500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-00959b04-3579-47d4-a86d-3b2e648722fc req-4a179751-62ac-4a83-a228-6e5ac041c68f service nova] Creating event network-vif-unplugged:da10f762-bc62-4992-aee6-1b182938963c for instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 on hv-cinder-83602 Aug 10 17:00:34.504783 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-00959b04-3579-47d4-a86d-3b2e648722fc req-4a179751-62ac-4a83-a228-6e5ac041c68f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086826 Aug 10 17:00:34.505361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 425/835] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:00:34.574722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:34.575322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:34.577740 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=94 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:34.583489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:34.584260 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:34.584694 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:34.585381 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:34.585830 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:34.586251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:34.719839 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:34.727767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:34.729303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:34.730470 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6a1cb62a-e999-4319-82e1-e683f56ff3bd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1721 microversion: 2.20 time: 0.159572 Aug 10 17:00:34.731025 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 411/836] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:34 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:34.845396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bf6a42c0-a6a1-41c8-ba52-8d72ad60e1ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:34.846080 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bf6a42c0-a6a1-41c8-ba52-8d72ad60e1ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:34.852309 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf6a42c0-a6a1-41c8-ba52-8d72ad60e1ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:34.852791 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf6a42c0-a6a1-41c8-ba52-8d72ad60e1ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:34.853217 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf6a42c0-a6a1-41c8-ba52-8d72ad60e1ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:34.853904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf6a42c0-a6a1-41c8-ba52-8d72ad60e1ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:34.854349 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf6a42c0-a6a1-41c8-ba52-8d72ad60e1ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:34.854993 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf6a42c0-a6a1-41c8-ba52-8d72ad60e1ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:35.061512 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bf6a42c0-a6a1-41c8-ba52-8d72ad60e1ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:35.070600 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bf6a42c0-a6a1-41c8-ba52-8d72ad60e1ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1452 microversion: 2.1 time: 0.229910 Aug 10 17:00:35.071319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 426/837] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:34 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1452 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:35.092018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ec4e3ae9-f9af-435e-87f6-97721a228000 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:35.092653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ec4e3ae9-f9af-435e-87f6-97721a228000 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:35.099939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec4e3ae9-f9af-435e-87f6-97721a228000 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:35.100454 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec4e3ae9-f9af-435e-87f6-97721a228000 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:35.100887 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec4e3ae9-f9af-435e-87f6-97721a228000 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:35.101581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec4e3ae9-f9af-435e-87f6-97721a228000 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:35.102057 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec4e3ae9-f9af-435e-87f6-97721a228000 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:35.102434 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec4e3ae9-f9af-435e-87f6-97721a228000 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:35.179346 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c4373f9d-90c7-4794-b343-da42eff08099 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:35.179953 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c4373f9d-90c7-4794-b343-da42eff08099 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:35.185943 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c4373f9d-90c7-4794-b343-da42eff08099 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:35.186431 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c4373f9d-90c7-4794-b343-da42eff08099 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:35.186860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c4373f9d-90c7-4794-b343-da42eff08099 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:35.187546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c4373f9d-90c7-4794-b343-da42eff08099 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:35.187998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c4373f9d-90c7-4794-b343-da42eff08099 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:35.188450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c4373f9d-90c7-4794-b343-da42eff08099 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:35.230371 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ec4e3ae9-f9af-435e-87f6-97721a228000 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:35.237745 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ec4e3ae9-f9af-435e-87f6-97721a228000 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1452 microversion: 2.1 time: 0.149973 Aug 10 17:00:35.238970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 412/838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:35 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:35.320686 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c4373f9d-90c7-4794-b343-da42eff08099 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:35.328429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c4373f9d-90c7-4794-b343-da42eff08099 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1710 microversion: 2.1 time: 0.153554 Aug 10 17:00:35.328988 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 427/839] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:35 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:35.754630 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:35.755192 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:35.762822 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:35.763310 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:35.763747 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:35.764465 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:35.764919 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:35.765344 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:36.014799 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:36.023279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:36.024830 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:36.026023 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e5ee140d-3b60-4a53-a963-0b72a37c954f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1721 microversion: 2.20 time: 0.275444 Aug 10 17:00:36.026582 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 413/840] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:35 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:36.349641 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1f9c57c6-d15a-45de-bbdb-7eff11ebbfd9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:36.350372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1f9c57c6-d15a-45de-bbdb-7eff11ebbfd9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:36.357360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f9c57c6-d15a-45de-bbdb-7eff11ebbfd9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:36.357918 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f9c57c6-d15a-45de-bbdb-7eff11ebbfd9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:36.358412 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f9c57c6-d15a-45de-bbdb-7eff11ebbfd9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:36.359103 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f9c57c6-d15a-45de-bbdb-7eff11ebbfd9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:36.359548 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f9c57c6-d15a-45de-bbdb-7eff11ebbfd9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:36.359964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1f9c57c6-d15a-45de-bbdb-7eff11ebbfd9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:36.504952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1f9c57c6-d15a-45de-bbdb-7eff11ebbfd9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:36.513393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1f9c57c6-d15a-45de-bbdb-7eff11ebbfd9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1710 microversion: 2.1 time: 0.167587 Aug 10 17:00:36.514074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 428/841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:36 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1710 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:37.048455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:37.049728 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:37.056970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:37.057460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:37.057897 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:37.058596 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:37.059045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:37.059600 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:37.181028 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-5e4d4c03-0f55-4d98-b600-6eefb2c418de req-f4dadb4b-508c-49bc-a89b-4df3a76322c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6995ac7-abff-47f3-a48c-a24fc437717e", "tag": "e581d1b5-c12c-49b1-91c7-4fddf08829ab"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:00:37.198831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5e4d4c03-0f55-4d98-b600-6eefb2c418de req-f4dadb4b-508c-49bc-a89b-4df3a76322c2 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:37.204294 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5e4d4c03-0f55-4d98-b600-6eefb2c418de req-f4dadb4b-508c-49bc-a89b-4df3a76322c2 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:37.204847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5e4d4c03-0f55-4d98-b600-6eefb2c418de req-f4dadb4b-508c-49bc-a89b-4df3a76322c2 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:37.224234 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-5e4d4c03-0f55-4d98-b600-6eefb2c418de req-f4dadb4b-508c-49bc-a89b-4df3a76322c2 service nova] Creating event network-changed:e581d1b5-c12c-49b1-91c7-4fddf08829ab for instance f6995ac7-abff-47f3-a48c-a24fc437717e on hv-cinder-83602 Aug 10 17:00:37.232607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-5e4d4c03-0f55-4d98-b600-6eefb2c418de req-f4dadb4b-508c-49bc-a89b-4df3a76322c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132015 Aug 10 17:00:37.233505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 429/842] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:00:37.296900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:37.330973 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:37.338576 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:37.343386 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d4ea674-8871-418e-9153-da2c08829f13 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1721 microversion: 2.20 time: 0.295271 Aug 10 17:00:37.344862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 414/843] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:37 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:37.536092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8cdc2b12-f4dc-4b3b-897a-72e9a9f67609 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:37.536811 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8cdc2b12-f4dc-4b3b-897a-72e9a9f67609 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:37.545130 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cdc2b12-f4dc-4b3b-897a-72e9a9f67609 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:37.545587 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cdc2b12-f4dc-4b3b-897a-72e9a9f67609 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:37.546015 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cdc2b12-f4dc-4b3b-897a-72e9a9f67609 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:37.546706 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cdc2b12-f4dc-4b3b-897a-72e9a9f67609 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:37.547164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cdc2b12-f4dc-4b3b-897a-72e9a9f67609 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:37.547770 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8cdc2b12-f4dc-4b3b-897a-72e9a9f67609 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:37.799562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8cdc2b12-f4dc-4b3b-897a-72e9a9f67609 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:37.812295 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8cdc2b12-f4dc-4b3b-897a-72e9a9f67609 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1710 microversion: 2.1 time: 0.278724 Aug 10 17:00:37.820341 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 430/844] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:37 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1710 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:00:38.370799 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:38.371409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:38.378204 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:38.379186 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:38.379630 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:38.382850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:38.382850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:38.382850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:38.383989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:38.516498 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:38.524558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:38.526072 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:38.527225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-58a97ec2-113f-4c4c-8d22-111110025795 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1664 microversion: 2.20 time: 0.160347 Aug 10 17:00:38.527790 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 415/845] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:38 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:38.549399 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-943921d4-36f7-4952-9ef7-3913c00d053f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "763be886-6c06-4592-aa01-59ed583f5edc"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:00:38.552296 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-943921d4-36f7-4952-9ef7-3913c00d053f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:38.558752 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-943921d4-36f7-4952-9ef7-3913c00d053f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:38.559267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-943921d4-36f7-4952-9ef7-3913c00d053f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:38.559700 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-943921d4-36f7-4952-9ef7-3913c00d053f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:38.560404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-943921d4-36f7-4952-9ef7-3913c00d053f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:38.560847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-943921d4-36f7-4952-9ef7-3913c00d053f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:38.561260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-943921d4-36f7-4952-9ef7-3913c00d053f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:38.835247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fd3b2af1-128c-4a95-a26c-9fe8bf463a73 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:38.835967 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fd3b2af1-128c-4a95-a26c-9fe8bf463a73 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:38.842132 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd3b2af1-128c-4a95-a26c-9fe8bf463a73 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:38.842677 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd3b2af1-128c-4a95-a26c-9fe8bf463a73 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:38.843113 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd3b2af1-128c-4a95-a26c-9fe8bf463a73 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:38.843964 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd3b2af1-128c-4a95-a26c-9fe8bf463a73 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:38.844493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd3b2af1-128c-4a95-a26c-9fe8bf463a73 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:38.845044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd3b2af1-128c-4a95-a26c-9fe8bf463a73 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:38.856604 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-943921d4-36f7-4952-9ef7-3913c00d053f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "POST /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311320 Aug 10 17:00:38.857526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 431/846] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Aug 10 17:00:38 2022] POST /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:00:38.982126 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9cf7f878-707f-42dd-9ed4-53a8d98716f5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:00:38.982857 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9cf7f878-707f-42dd-9ed4-53a8d98716f5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:38.989375 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cf7f878-707f-42dd-9ed4-53a8d98716f5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:38.989949 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cf7f878-707f-42dd-9ed4-53a8d98716f5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:38.990447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cf7f878-707f-42dd-9ed4-53a8d98716f5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:38.991481 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cf7f878-707f-42dd-9ed4-53a8d98716f5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:38.992009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cf7f878-707f-42dd-9ed4-53a8d98716f5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:38.992545 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cf7f878-707f-42dd-9ed4-53a8d98716f5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:38.993209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-fd3b2af1-128c-4a95-a26c-9fe8bf463a73 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:39.001240 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fd3b2af1-128c-4a95-a26c-9fe8bf463a73 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1714 microversion: 2.1 time: 0.174925 Aug 10 17:00:39.001812 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 416/847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:00:38 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1714 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:00:39.076063 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9cf7f878-707f-42dd-9ed4-53a8d98716f5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120608) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 17:00:39.109467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:39.145503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9cf7f878-707f-42dd-9ed4-53a8d98716f5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "POST /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/action" status: 202 len: 0 microversion: 2.20 time: 0.166723 Aug 10 17:00:39.146201 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 432/848] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Aug 10 17:00:38 2022] POST /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:00:39.154320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:39.154926 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:39.160724 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:39.161210 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:39.161650 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:39.162342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:39.162795 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:39.163218 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:39.304115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:39.313726 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:39.315491 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:39.317330 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-534061ea-d3d8-4784-a1b1-0491d991ba70 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1750 microversion: 2.20 time: 0.166867 Aug 10 17:00:39.317887 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 417/849] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:39 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:40.339914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:40.340619 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:40.344057 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:40.347880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:40.348382 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:40.348810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:40.349487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:40.349932 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:40.350350 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:40.480787 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:40.489733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:40.491250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:40.492423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-53e64aff-5827-46c9-9cd7-2961f0689bbd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1752 microversion: 2.20 time: 0.156988 Aug 10 17:00:40.492972 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 433/850] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:40 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:00:41.515501 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:41.516132 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:41.522718 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:41.523216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:41.523655 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:41.524381 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:41.524846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:41.525274 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:41.653917 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:41.662217 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:41.663768 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:41.664891 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c6c811c9-a20d-4aaa-9db4-ac6d4d4a5e16 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1752 microversion: 2.20 time: 0.153278 Aug 10 17:00:41.665453 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 418/851] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:41 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:42.686709 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:42.687316 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:42.694281 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:42.694762 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:42.695193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:42.695872 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:42.696361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:42.696785 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:42.820196 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:42.828317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:42.829794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:42.830935 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6b5994cd-6b1e-47bc-aba2-da64cb6b14b9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1752 microversion: 2.20 time: 0.148048 Aug 10 17:00:42.831481 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 434/852] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:42 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:43.854110 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:43.854755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:43.861279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:43.861763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:43.862194 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:43.862881 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:43.863338 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:43.863760 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:44.001147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:44.010010 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:44.011523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:44.012720 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-31b6aa76-7a8b-4a13-9dd9-5eeda24e2902 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1752 microversion: 2.20 time: 0.162482 Aug 10 17:00:44.020570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 419/853] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:43 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:45.036683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:45.037285 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:45.043727 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:45.044232 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:45.044662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:45.045344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:45.045794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:45.046214 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:45.177898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:45.186308 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:45.187791 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:45.188966 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8f18ba2e-01db-4382-987a-8733063f296a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1752 microversion: 2.20 time: 0.156771 Aug 10 17:00:45.189513 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 435/854] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:45 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:46.211315 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:46.211868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:46.218573 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:46.219058 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:46.219488 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:46.220200 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:46.220689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:46.221145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:46.353586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:46.362037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:46.364297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:46.365435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb9b96d0-ac74-4ef7-96d1-c6f5e002e453 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1752 microversion: 2.20 time: 0.158366 Aug 10 17:00:46.365993 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 420/855] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:46 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:47.388279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:47.388829 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:47.395724 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:47.396219 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:47.396650 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:47.397323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:47.397766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:47.398187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:47.524967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:47.533269 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:47.534750 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:47.535890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6050da5e-84eb-41d8-8154-fa3b2edc6247 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1752 microversion: 2.20 time: 0.151634 Aug 10 17:00:47.536560 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 436/856] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:47 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:48.558702 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:48.559437 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:48.566668 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:48.567164 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:48.567606 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:48.568343 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:48.568808 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:48.569255 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:48.711796 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:48.720715 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:48.722432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:48.723674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-32e9f40a-06ac-439c-886b-ac8bf9c5dac7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1752 microversion: 2.20 time: 0.168864 Aug 10 17:00:48.724524 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 421/857] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:48 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:49.746845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:49.747450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:49.753677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:49.754158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:49.754591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:49.755281 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:49.755733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:49.756182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:49.888880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:49.898956 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:49.900455 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:49.901620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-dce41707-e579-402e-b277-7654573aa163 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.158656 Aug 10 17:00:49.912791 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 437/858] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:49 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:50.924513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:50.925122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:50.931249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:50.931798 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:50.932235 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:50.933336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:50.933336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:50.934022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:51.069402 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:51.077713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:51.079214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:51.080400 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a808b2fc-4f05-4b3d-9eef-cac2b869efb9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.159706 Aug 10 17:00:51.080962 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 422/859] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:50 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:52.104204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:52.104813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:52.111047 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:52.111532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:52.111962 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:52.112671 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:52.113120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:52.113539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:52.239592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:52.247877 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:52.249397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:52.250537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f9ea5461-2a27-4a16-9aac-0ea0919f7434 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.150257 Aug 10 17:00:52.251092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 438/860] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:52 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:53.272426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:53.273028 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:53.279317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:53.279797 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:53.280257 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:53.280938 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:53.281387 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:53.281804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:53.640343 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:53.650435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:53.652184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:53.653885 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-34be2b2f-6242-4989-bf4e-23f02783e0d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.385045 Aug 10 17:00:53.655187 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 423/861] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:53 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:54.678327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:54.678928 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:54.685477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:54.685959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:54.686384 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:54.687066 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:54.687513 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:54.689116 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:54.824779 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:54.840392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:54.841910 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:54.843071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4009eec1-5ba8-44bd-89f5-ba704e0b20e1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.169163 Aug 10 17:00:54.843618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 439/862] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:54 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:55.873165 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:55.873710 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:55.880842 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:55.881432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:55.881871 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:55.882586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:55.883034 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:55.883460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:56.029275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:56.038420 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:56.044991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:56.046484 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a594f445-6995-4376-ad3f-5a79708ffe3a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.178155 Aug 10 17:00:56.052192 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 424/863] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:55 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:57.075851 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:57.076662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:57.084216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:57.096980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:57.097424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:57.098155 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:57.098606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:57.099025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:57.229080 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:57.238030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:57.239529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:57.240721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0edf61f2-53c7-48f0-8ce5-979ae79edffa tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.168712 Aug 10 17:00:57.241419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 440/864] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:57 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:58.263493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:58.264211 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:58.271794 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:58.272255 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:58.272680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:58.273429 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:58.273868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:58.275083 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:58.452432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:58.466009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:58.467684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:58.469105 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6c98f3d4-231d-4302-851a-0107160e5e86 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.210126 Aug 10 17:00:58.469680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 425/865] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:58 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:00:59.492400 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:00:59.493090 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:00:59.499335 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:59.499814 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:59.500276 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:59.500994 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:00:59.501444 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:00:59.501863 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:00:59.631739 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:59.640738 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:59.642219 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:00:59.643391 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e101078f-bd16-4e25-bedd-683801eb8033 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.155084 Aug 10 17:00:59.644635 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 441/866] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:00:59 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:00.667669 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:00.668263 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:00.674675 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:00.675169 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:00.675608 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:00.677179 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:00.677830 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:00.678269 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:00.813165 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:00.822011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:00.823523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:00.824728 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-78125ee4-8948-493a-a3de-4dc9dd457eb7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.161197 Aug 10 17:01:00.825296 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 426/867] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:00 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:01:01.848544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:01.850244 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:01.858681 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:01.858681 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:01.859038 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:01.859637 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:01.860097 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:01.861507 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:02.000952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:02.010435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:02.011935 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:02.013102 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-80adbeff-5ec5-4c35-b6be-c0b9139589ac tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.169956 Aug 10 17:01:02.013660 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 442/868] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:01 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:03.038187 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:03.038765 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:03.044692 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:03.045179 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:03.045610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:03.046297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:03.046746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:03.047164 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:03.179197 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:03.187525 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:03.189032 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:03.190164 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5627bc6a-92d0-455d-a105-1983da6b6211 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.157170 Aug 10 17:01:03.190716 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 427/869] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:03 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:04.214155 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:04.214759 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:04.222078 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:04.223503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:04.223989 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:04.224708 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:04.225161 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:04.225588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:04.362676 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:04.371956 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:04.373580 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:04.374823 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c2aad170-591a-4971-b168-9a8f16598ec2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.164598 Aug 10 17:01:04.378907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 443/870] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:04 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:05.399036 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:05.399650 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:05.401995 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=34 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:05.407359 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:05.407889 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:05.408351 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:05.409052 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:05.409523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:05.409940 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:05.548909 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:05.558057 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:05.559585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:05.560774 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d8fec347-9e72-4545-a51c-4e82db7dc5cb tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.166250 Aug 10 17:01:05.561346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 428/871] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:05 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:06.584822 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:06.586096 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:06.593597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:06.594269 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:06.594854 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:06.595570 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:06.596182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:06.596752 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:06.775620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:06.786590 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:06.788122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:06.789312 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a778fd15-7f16-4006-9f86-e1431c7ed06a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.209397 Aug 10 17:01:06.789862 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 444/872] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:06 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:07.813081 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:07.813911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:07.821431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:07.822094 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:07.822540 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:07.823258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:07.824124 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:07.824666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:08.011558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:08.028920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:08.030632 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:08.031843 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5b7b4fef-cba0-4e6c-926c-931b1841c76a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.222843 Aug 10 17:01:08.032900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 429/873] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:07 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:09.055097 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:09.056289 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:09.068572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:09.073918 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:09.073918 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:09.073918 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:09.073918 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:09.074298 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:09.328310 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:09.332711 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:09.349633 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:09.351424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:09.353009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-01d545f2-a3b9-4041-b110-2c6dded466d6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.301805 Aug 10 17:01:09.356064 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 445/874] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:09 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:10.379290 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:10.379910 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:10.388448 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:10.389128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:10.389785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:10.390658 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:10.391287 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:10.391874 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:10.395229 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=90 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:10.548132 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:10.560138 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:10.561926 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:10.563156 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-427290c7-b5f0-4376-9aae-783f814cb035 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.188711 Aug 10 17:01:10.563916 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 430/875] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:10 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:11.588798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:11.589435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:11.595716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=25 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:11.599516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:11.600004 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:11.600882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:11.602288 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:11.602744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:11.603643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:11.768125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:11.778762 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:11.780293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:11.781465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f7639f73-b392-4c9c-8e6c-feafb2626276 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.198688 Aug 10 17:01:11.782023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 446/876] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:11 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:12.806354 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:12.807102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:12.813806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:12.814304 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:12.814930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:12.815821 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:12.816610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:12.817173 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:12.985156 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:12.993766 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:12.995272 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:12.996507 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-603bb14c-e3c2-4f33-b17f-26cc4280840d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.195450 Aug 10 17:01:12.997594 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 431/877] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:12 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:14.025551 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:14.026927 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:14.035113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:14.035749 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:14.036360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:14.037294 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:14.037951 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:14.038608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:14.469261 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:14.479659 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:14.485895 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:14.487465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bc029ff7-a01e-459f-a568-079cd362b4a1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.471342 Aug 10 17:01:14.489397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 447/878] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:14 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:15.513874 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:15.515646 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:15.524798 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:15.532625 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:15.533385 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:15.534307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:15.534979 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:15.535557 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:15.806487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:15.817673 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:15.819571 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:15.821285 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1470033d-ee52-4e61-be69-cdb8bffd325e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.313226 Aug 10 17:01:15.822471 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 432/879] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:15 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:16.844090 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:16.845082 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:16.855164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:16.855876 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:16.857338 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:16.858327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:16.859624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:16.860332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:17.026540 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:17.037244 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:17.039011 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:17.040406 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d04b76f4-288c-47da-ae6d-88f87fa0215b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.200139 Aug 10 17:01:17.053131 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 448/880] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:16 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:17.442905 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e02c095a-b7ff-47e3-b73a-904688781346 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Action: 'create', calling method: .version_select at 0x7f5b08377700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1933468789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsQFbE/hMZJky3iAf7r91qmsGbX/ogxwHL5eOZ4feGbSoSNgjHXNoCSbUjIc5ZxQakRG+kfOHYw6AHVkFrP7jwMsTSDhCKwvaKRuHC5wmvuwMkjgbnE2E57TWlbtnvTxQ=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:01:17.459382 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-e02c095a-b7ff-47e3-b73a-904688781346 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Getting quotas for project 4c868216664144beb0a3a0360c56e637. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:01:17.464256 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-e02c095a-b7ff-47e3-b73a-904688781346 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Getting quotas for user 5d0f55fa4717472db61860fd31f5e427 and project 4c868216664144beb0a3a0360c56e637. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:01:17.489399 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e02c095a-b7ff-47e3-b73a-904688781346 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.259341 Aug 10 17:01:17.490134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 433/881] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 10 17:01:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:01:18.065120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:18.065723 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:18.072680 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:18.073070 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:18.073571 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:18.074273 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:18.074750 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:18.075168 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:18.252374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:18.265552 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:18.267624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:18.269142 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e4b47527-f610-4d6e-9a16-f14afe9a2a76 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.207795 Aug 10 17:01:18.270020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 449/882] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:18 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:19.292250 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:19.292869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:19.300619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:19.301237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:19.301753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:19.302571 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:19.303333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:19.303831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:19.469271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:19.478988 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:19.480720 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:19.482106 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cb2887bf-be59-4e6b-97d4-ffa1cd1091c8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.193840 Aug 10 17:01:19.482864 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 434/883] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:19 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:20.509018 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:20.509720 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:20.517593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:20.518112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:20.518579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:20.519798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:20.520281 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:20.520707 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:20.661025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:20.670159 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:20.671650 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:20.672837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e4729d68-1e53-4d2d-b6df-1b0e68b44ff7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.168128 Aug 10 17:01:20.673389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 450/884] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:20 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:01:21.696510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:21.697122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:21.703189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:21.703675 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:21.704109 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:21.704828 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:21.705282 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:21.705774 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:21.834768 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:21.843115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:21.844641 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:21.845786 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-49bdda99-cb2c-43ad-b575-9964d14fe0f2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.153372 Aug 10 17:01:21.846341 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 435/885] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:21 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:22.870261 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:22.870776 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:22.877380 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:22.877859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:22.878285 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:22.879820 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:22.880296 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:22.880728 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:23.014011 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:23.024036 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:23.025564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:23.026742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4f7c6f43-03c4-4c09-a2d0-490c958dfb88 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.161034 Aug 10 17:01:23.027299 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 451/886] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:22 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:24.051385 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:24.051990 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:24.058522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:24.059003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:24.059436 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:24.060122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:24.060597 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:24.061022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:24.195197 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:24.204022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:24.206008 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:24.207673 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0caaba63-fe22-4505-9a60-154b54926709 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.160901 Aug 10 17:01:24.208457 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 436/887] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:24 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:24.648656 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-787b3b09-518d-4590-a697-5e04d9c56515 req-54525f6b-9f48-4541-bfec-e07457fc8fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c45104f-0ee5-4fec-92ad-7937cbe53805", "name": "network-vif-plugged", "status": "completed", "tag": "da10f762-bc62-4992-aee6-1b182938963c"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:01:24.658844 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-787b3b09-518d-4590-a697-5e04d9c56515 req-54525f6b-9f48-4541-bfec-e07457fc8fb1 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:24.659335 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-787b3b09-518d-4590-a697-5e04d9c56515 req-54525f6b-9f48-4541-bfec-e07457fc8fb1 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:24.659754 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-787b3b09-518d-4590-a697-5e04d9c56515 req-54525f6b-9f48-4541-bfec-e07457fc8fb1 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:24.670961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-787b3b09-518d-4590-a697-5e04d9c56515 req-54525f6b-9f48-4541-bfec-e07457fc8fb1 service nova] Creating event network-vif-plugged:da10f762-bc62-4992-aee6-1b182938963c for instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 on hv-cinder-83602 Aug 10 17:01:24.675926 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-787b3b09-518d-4590-a697-5e04d9c56515 req-54525f6b-9f48-4541-bfec-e07457fc8fb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031914 Aug 10 17:01:24.676732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 452/888] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:01:25.232712 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:25.234045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:25.241619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:25.242105 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:25.243336 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:25.244047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:25.244721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:25.245239 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:25.394943 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:25.403755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:25.405616 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:25.407267 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6d1ec654-c4bd-4cd3-bf36-6a2e65f431d0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.178951 Aug 10 17:01:25.419617 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 437/889] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:25 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:26.432527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:26.433203 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:26.439798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:26.440323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:26.440758 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:26.441449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:26.441897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:26.442928 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:26.578167 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:26.586913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:26.588431 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:26.589578 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d66b527b-1dfd-45c8-99d2-0d27ce9f23ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.162800 Aug 10 17:01:26.590129 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 453/890] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:26 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:27.612036 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:27.612678 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:27.615154 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:27.621341 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:27.621859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:27.622322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:27.623078 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:27.623598 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:27.623975 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:27.768407 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:27.780989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:27.782925 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:27.784086 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8bd713a6-0ee9-4ab6-bffb-4af232a74f83 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1808 microversion: 2.20 time: 0.175887 Aug 10 17:01:27.784674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 438/891] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:27 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:01:28.808367 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:28.809169 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:28.815459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:28.815936 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:28.816464 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:28.817152 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:28.817596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:28.818010 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:28.946991 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:28.955266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:28.956791 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:28.958441 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-300e5446-9ddd-4283-adc6-749cc5047953 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1795 microversion: 2.20 time: 0.153819 Aug 10 17:01:28.959260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 454/892] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:01:28 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1795 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:01:31.756403 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72e7f116-14a5-4aa0-a2d6-04a67b83dedb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93282e50-d378-403c-adf8-0022ea8567cc"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:01:31.758823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-72e7f116-14a5-4aa0-a2d6-04a67b83dedb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:31.764841 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e7f116-14a5-4aa0-a2d6-04a67b83dedb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:31.765333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e7f116-14a5-4aa0-a2d6-04a67b83dedb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:31.765770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e7f116-14a5-4aa0-a2d6-04a67b83dedb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:31.766467 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e7f116-14a5-4aa0-a2d6-04a67b83dedb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:31.766929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e7f116-14a5-4aa0-a2d6-04a67b83dedb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:31.767362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e7f116-14a5-4aa0-a2d6-04a67b83dedb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:32.034324 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-72e7f116-14a5-4aa0-a2d6-04a67b83dedb tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "POST /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380006 Aug 10 17:01:32.034939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 439/893] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 17:01:31 2022] POST /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:01:40.611621 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-944a02e4-593c-46a1-a7a3-d997a7e9bf5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:01:40.613853 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-944a02e4-593c-46a1-a7a3-d997a7e9bf5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:40.616387 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=17 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:40.617060 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=51 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:40.622498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-944a02e4-593c-46a1-a7a3-d997a7e9bf5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:40.622981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-944a02e4-593c-46a1-a7a3-d997a7e9bf5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:40.623416 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-944a02e4-593c-46a1-a7a3-d997a7e9bf5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:40.624103 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-944a02e4-593c-46a1-a7a3-d997a7e9bf5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:40.624585 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-944a02e4-593c-46a1-a7a3-d997a7e9bf5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:40.625009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-944a02e4-593c-46a1-a7a3-d997a7e9bf5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:40.649857 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-944a02e4-593c-46a1-a7a3-d997a7e9bf5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lazy-loading 'flavor' on Instance uuid c5e3c08d-8649-4c99-8c7c-a57166ebc96b {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:01:40.769975 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-944a02e4-593c-46a1-a7a3-d997a7e9bf5c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "POST /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/action" status: 200 len: 32 microversion: 2.1 time: 0.162189 Aug 10 17:01:40.770674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 455/894] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 17:01:40 2022] POST /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:01:40.781340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-026cf3ae-8448-4c70-9b48-275cba7b073f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:40.782043 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-026cf3ae-8448-4c70-9b48-275cba7b073f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:40.783972 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:40.790413 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-026cf3ae-8448-4c70-9b48-275cba7b073f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:40.791033 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-026cf3ae-8448-4c70-9b48-275cba7b073f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:40.791485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-026cf3ae-8448-4c70-9b48-275cba7b073f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:40.792204 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-026cf3ae-8448-4c70-9b48-275cba7b073f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:40.792665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-026cf3ae-8448-4c70-9b48-275cba7b073f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:40.793094 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-026cf3ae-8448-4c70-9b48-275cba7b073f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:40.797605 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:40.946971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-026cf3ae-8448-4c70-9b48-275cba7b073f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:40.954873 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-026cf3ae-8448-4c70-9b48-275cba7b073f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.178547 Aug 10 17:01:40.960939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 440/895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:40 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:41.977027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-06c1d9d5-e45b-4975-a793-c2dc30811f2b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:41.977720 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-06c1d9d5-e45b-4975-a793-c2dc30811f2b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:41.984318 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06c1d9d5-e45b-4975-a793-c2dc30811f2b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:41.984809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06c1d9d5-e45b-4975-a793-c2dc30811f2b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:41.985242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06c1d9d5-e45b-4975-a793-c2dc30811f2b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:41.985937 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06c1d9d5-e45b-4975-a793-c2dc30811f2b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:41.986393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06c1d9d5-e45b-4975-a793-c2dc30811f2b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:41.986821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06c1d9d5-e45b-4975-a793-c2dc30811f2b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:42.118194 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-06c1d9d5-e45b-4975-a793-c2dc30811f2b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:42.126041 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-06c1d9d5-e45b-4975-a793-c2dc30811f2b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.153178 Aug 10 17:01:42.135279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 456/896] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:41 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:42.142400 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:01:42.142793 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Wed Aug 10 17:01:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:01:43.156641 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f69f9471-165a-4e72-9af4-950a17bb47f6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:43.157286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f69f9471-165a-4e72-9af4-950a17bb47f6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:43.164354 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f69f9471-165a-4e72-9af4-950a17bb47f6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:43.164843 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f69f9471-165a-4e72-9af4-950a17bb47f6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:43.165281 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f69f9471-165a-4e72-9af4-950a17bb47f6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:43.165977 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f69f9471-165a-4e72-9af4-950a17bb47f6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:43.166433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f69f9471-165a-4e72-9af4-950a17bb47f6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:43.166865 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f69f9471-165a-4e72-9af4-950a17bb47f6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:43.292162 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f69f9471-165a-4e72-9af4-950a17bb47f6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:43.299930 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f69f9471-165a-4e72-9af4-950a17bb47f6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.147042 Aug 10 17:01:43.300523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 441/897] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:43 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:44.321223 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-634a37ec-3073-48e0-a46f-0296c4041a66 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:44.321851 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-634a37ec-3073-48e0-a46f-0296c4041a66 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:44.328601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634a37ec-3073-48e0-a46f-0296c4041a66 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:44.329091 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634a37ec-3073-48e0-a46f-0296c4041a66 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:44.329531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634a37ec-3073-48e0-a46f-0296c4041a66 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:44.330230 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634a37ec-3073-48e0-a46f-0296c4041a66 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:44.330682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634a37ec-3073-48e0-a46f-0296c4041a66 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:44.331112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634a37ec-3073-48e0-a46f-0296c4041a66 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:44.465077 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-634a37ec-3073-48e0-a46f-0296c4041a66 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:44.473196 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-634a37ec-3073-48e0-a46f-0296c4041a66 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.155948 Aug 10 17:01:44.473750 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 457/898] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:44 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:45.324436 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1951325374", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1933468789", "security_groups": [{"name": "tempest-secgroup-smoke-1282758608"}], "networks": [{"uuid": "8c638e71-2585-477d-88f5-6133c99d55bc"}], "block_device_mapping_v2": [{"uuid": "eb9ba800-b4a0-432c-a82b-40f922421b67", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:01:45.437957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] validate_networks() for [('8c638e71-2585-477d-88f5-6133c99d55bc', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:01:45.495485 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d529c691-fcfb-476a-904f-9ae9bac1ae78 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:45.496090 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d529c691-fcfb-476a-904f-9ae9bac1ae78 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:45.502334 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d529c691-fcfb-476a-904f-9ae9bac1ae78 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:45.502813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d529c691-fcfb-476a-904f-9ae9bac1ae78 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:45.503242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d529c691-fcfb-476a-904f-9ae9bac1ae78 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:45.503921 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d529c691-fcfb-476a-904f-9ae9bac1ae78 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:45.504395 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d529c691-fcfb-476a-904f-9ae9bac1ae78 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:45.504811 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d529c691-fcfb-476a-904f-9ae9bac1ae78 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:45.632382 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d529c691-fcfb-476a-904f-9ae9bac1ae78 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:45.642386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d529c691-fcfb-476a-904f-9ae9bac1ae78 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.150522 Aug 10 17:01:45.642869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 458/899] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:45 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:01:45.915450 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:01:45.915870 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:01:45.916390 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:01:45.916794 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:01:45.917200 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:01:45.925804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:45.926276 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:45.926710 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:45.927422 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:45.927872 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:45.928326 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:45.944215 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Getting quotas for project 4c868216664144beb0a3a0360c56e637. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:01:45.948073 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Getting quotas for user 5d0f55fa4717472db61860fd31f5e427 and project 4c868216664144beb0a3a0360c56e637. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:01:46.010804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:01:46.012912 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb9ba800-b4a0-432c-a82b-40f922421b67',volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:01:46.137523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-de544942-98d3-4122-85f5-007a1e579383 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818564 Aug 10 17:01:46.138194 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 442/900] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 17:01:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:01:46.149731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c33b099e-057d-4594-a1c9-154361616ed3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:46.150335 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c33b099e-057d-4594-a1c9-154361616ed3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:46.206155 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c33b099e-057d-4594-a1c9-154361616ed3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:46.213756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c33b099e-057d-4594-a1c9-154361616ed3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1089 microversion: 2.1 time: 0.068423 Aug 10 17:01:46.214319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 459/901] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:46 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:46.663422 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-21752a41-76b0-4fbf-9d38-3c041eb998d0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:46.664050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-21752a41-76b0-4fbf-9d38-3c041eb998d0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:46.671121 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21752a41-76b0-4fbf-9d38-3c041eb998d0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:46.671622 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21752a41-76b0-4fbf-9d38-3c041eb998d0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:46.672230 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21752a41-76b0-4fbf-9d38-3c041eb998d0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:46.672962 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21752a41-76b0-4fbf-9d38-3c041eb998d0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:46.673421 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21752a41-76b0-4fbf-9d38-3c041eb998d0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:46.673851 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21752a41-76b0-4fbf-9d38-3c041eb998d0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:46.810476 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-21752a41-76b0-4fbf-9d38-3c041eb998d0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:46.818749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-21752a41-76b0-4fbf-9d38-3c041eb998d0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.159617 Aug 10 17:01:46.819862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 443/902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:46 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:47.234492 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1b06b02c-5bc4-4629-80d8-1b245407c2d7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:47.235089 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1b06b02c-5bc4-4629-80d8-1b245407c2d7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:47.242473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b06b02c-5bc4-4629-80d8-1b245407c2d7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:47.242944 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b06b02c-5bc4-4629-80d8-1b245407c2d7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:47.243369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b06b02c-5bc4-4629-80d8-1b245407c2d7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:47.244042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b06b02c-5bc4-4629-80d8-1b245407c2d7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:47.244515 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b06b02c-5bc4-4629-80d8-1b245407c2d7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:47.244930 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b06b02c-5bc4-4629-80d8-1b245407c2d7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:47.306525 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1b06b02c-5bc4-4629-80d8-1b245407c2d7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:47.313891 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1b06b02c-5bc4-4629-80d8-1b245407c2d7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1187 microversion: 2.1 time: 0.083198 Aug 10 17:01:47.314441 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 460/903] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:47 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:47.841749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cf303566-dace-49a6-9cee-7ba5bb5ae8c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:47.842275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cf303566-dace-49a6-9cee-7ba5bb5ae8c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:47.848711 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf303566-dace-49a6-9cee-7ba5bb5ae8c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:47.849262 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf303566-dace-49a6-9cee-7ba5bb5ae8c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:47.849707 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf303566-dace-49a6-9cee-7ba5bb5ae8c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:47.850407 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf303566-dace-49a6-9cee-7ba5bb5ae8c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:47.850966 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf303566-dace-49a6-9cee-7ba5bb5ae8c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:47.851292 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf303566-dace-49a6-9cee-7ba5bb5ae8c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:47.985725 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-cf303566-dace-49a6-9cee-7ba5bb5ae8c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:47.995069 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cf303566-dace-49a6-9cee-7ba5bb5ae8c0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.157200 Aug 10 17:01:47.995640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 444/904] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:47 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:48.335206 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d5887902-8228-43da-a42b-732f3d7a816a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:48.336094 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d5887902-8228-43da-a42b-732f3d7a816a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:48.343537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d5887902-8228-43da-a42b-732f3d7a816a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:48.352756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d5887902-8228-43da-a42b-732f3d7a816a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:48.353468 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d5887902-8228-43da-a42b-732f3d7a816a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:48.354506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d5887902-8228-43da-a42b-732f3d7a816a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:48.354991 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d5887902-8228-43da-a42b-732f3d7a816a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:48.355423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d5887902-8228-43da-a42b-732f3d7a816a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:48.614028 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d5887902-8228-43da-a42b-732f3d7a816a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:48.624325 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d5887902-8228-43da-a42b-732f3d7a816a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1273 microversion: 2.1 time: 0.293514 Aug 10 17:01:48.624902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 461/905] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:48 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1273 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:49.016846 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6697244c-c33e-4b30-92a8-2a9c55f9c1d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:49.017465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6697244c-c33e-4b30-92a8-2a9c55f9c1d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:49.024662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6697244c-c33e-4b30-92a8-2a9c55f9c1d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:49.025470 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6697244c-c33e-4b30-92a8-2a9c55f9c1d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:49.026592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6697244c-c33e-4b30-92a8-2a9c55f9c1d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:49.027575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6697244c-c33e-4b30-92a8-2a9c55f9c1d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:49.028454 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6697244c-c33e-4b30-92a8-2a9c55f9c1d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:49.029336 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6697244c-c33e-4b30-92a8-2a9c55f9c1d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:49.076425 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4600f354-bfa8-457f-ad5c-eed9f19ebc16 req-9de20800-3af4-4f8e-9115-05a3f15f789a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca57c21-5ab9-42f0-ba5c-158b397c8223", "tag": "25c45962-3be8-4f45-8373-a67dfc93aa99"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:01:49.086724 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4600f354-bfa8-457f-ad5c-eed9f19ebc16 req-9de20800-3af4-4f8e-9115-05a3f15f789a service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:49.087212 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4600f354-bfa8-457f-ad5c-eed9f19ebc16 req-9de20800-3af4-4f8e-9115-05a3f15f789a service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:49.087651 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4600f354-bfa8-457f-ad5c-eed9f19ebc16 req-9de20800-3af4-4f8e-9115-05a3f15f789a service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:49.098680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4600f354-bfa8-457f-ad5c-eed9f19ebc16 req-9de20800-3af4-4f8e-9115-05a3f15f789a service nova] Creating event network-changed:25c45962-3be8-4f45-8373-a67dfc93aa99 for instance cca57c21-5ab9-42f0-ba5c-158b397c8223 on hv-cinder-83602 Aug 10 17:01:49.104115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4600f354-bfa8-457f-ad5c-eed9f19ebc16 req-9de20800-3af4-4f8e-9115-05a3f15f789a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121256 Aug 10 17:01:49.104792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 445/906] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:01:49.257056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6697244c-c33e-4b30-92a8-2a9c55f9c1d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:49.265044 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6697244c-c33e-4b30-92a8-2a9c55f9c1d1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.252074 Aug 10 17:01:49.265609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 462/907] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:49 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:49.646482 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-42447254-e64c-4115-8887-f7dfb3bc7ff3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:49.647237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-42447254-e64c-4115-8887-f7dfb3bc7ff3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:49.653406 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42447254-e64c-4115-8887-f7dfb3bc7ff3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:49.653883 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42447254-e64c-4115-8887-f7dfb3bc7ff3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:49.654315 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42447254-e64c-4115-8887-f7dfb3bc7ff3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:49.654996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42447254-e64c-4115-8887-f7dfb3bc7ff3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:49.655476 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42447254-e64c-4115-8887-f7dfb3bc7ff3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:49.655900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42447254-e64c-4115-8887-f7dfb3bc7ff3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:49.786563 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-42447254-e64c-4115-8887-f7dfb3bc7ff3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:49.793924 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-42447254-e64c-4115-8887-f7dfb3bc7ff3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.151742 Aug 10 17:01:49.794477 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 446/908] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:49 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:50.288646 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-aa5fa3b0-015d-4056-9004-14cc675dafd7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:50.289250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-aa5fa3b0-015d-4056-9004-14cc675dafd7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:50.295176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa5fa3b0-015d-4056-9004-14cc675dafd7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:50.295647 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa5fa3b0-015d-4056-9004-14cc675dafd7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:50.296071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa5fa3b0-015d-4056-9004-14cc675dafd7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:50.296772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa5fa3b0-015d-4056-9004-14cc675dafd7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:50.297217 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa5fa3b0-015d-4056-9004-14cc675dafd7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:50.297631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa5fa3b0-015d-4056-9004-14cc675dafd7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:50.428422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-aa5fa3b0-015d-4056-9004-14cc675dafd7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:50.436865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-aa5fa3b0-015d-4056-9004-14cc675dafd7 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.152739 Aug 10 17:01:50.437423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 463/909] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:50 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:50.814874 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a25cd3d-1092-4d5e-9734-26ea2258274c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:50.815478 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4a25cd3d-1092-4d5e-9734-26ea2258274c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:50.822290 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a25cd3d-1092-4d5e-9734-26ea2258274c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:50.822781 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a25cd3d-1092-4d5e-9734-26ea2258274c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:50.823211 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a25cd3d-1092-4d5e-9734-26ea2258274c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:50.823890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a25cd3d-1092-4d5e-9734-26ea2258274c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:50.824379 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a25cd3d-1092-4d5e-9734-26ea2258274c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:50.824803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a25cd3d-1092-4d5e-9734-26ea2258274c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:50.954111 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4a25cd3d-1092-4d5e-9734-26ea2258274c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:50.962721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4a25cd3d-1092-4d5e-9734-26ea2258274c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.151376 Aug 10 17:01:50.963044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 447/910] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:50 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:51.457001 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cd7168bc-9085-439b-8492-74e4f41855f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:51.457648 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cd7168bc-9085-439b-8492-74e4f41855f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:51.467040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd7168bc-9085-439b-8492-74e4f41855f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:51.467519 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd7168bc-9085-439b-8492-74e4f41855f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:51.467964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd7168bc-9085-439b-8492-74e4f41855f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:51.468677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd7168bc-9085-439b-8492-74e4f41855f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:51.469121 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd7168bc-9085-439b-8492-74e4f41855f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:51.469538 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd7168bc-9085-439b-8492-74e4f41855f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:51.601243 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cd7168bc-9085-439b-8492-74e4f41855f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:51.609054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cd7168bc-9085-439b-8492-74e4f41855f3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.155843 Aug 10 17:01:51.609613 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 464/911] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:51 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:51.983054 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c6eebee2-075d-409f-a65c-240714259826 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:51.983671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c6eebee2-075d-409f-a65c-240714259826 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:51.990420 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6eebee2-075d-409f-a65c-240714259826 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:51.990907 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6eebee2-075d-409f-a65c-240714259826 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:51.991518 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6eebee2-075d-409f-a65c-240714259826 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:51.992243 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6eebee2-075d-409f-a65c-240714259826 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:51.992705 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6eebee2-075d-409f-a65c-240714259826 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:51.993136 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6eebee2-075d-409f-a65c-240714259826 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:52.123649 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c6eebee2-075d-409f-a65c-240714259826 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:52.130970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c6eebee2-075d-409f-a65c-240714259826 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.151859 Aug 10 17:01:52.131543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 448/912] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:51 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:52.631101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-819082ed-c8ee-45df-9fa0-01cf58623ab0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:52.631705 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-819082ed-c8ee-45df-9fa0-01cf58623ab0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:52.638725 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-819082ed-c8ee-45df-9fa0-01cf58623ab0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:52.639204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-819082ed-c8ee-45df-9fa0-01cf58623ab0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:52.639636 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-819082ed-c8ee-45df-9fa0-01cf58623ab0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:52.640345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-819082ed-c8ee-45df-9fa0-01cf58623ab0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:52.640796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-819082ed-c8ee-45df-9fa0-01cf58623ab0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:52.641217 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-819082ed-c8ee-45df-9fa0-01cf58623ab0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:52.765425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-819082ed-c8ee-45df-9fa0-01cf58623ab0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:52.773267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-819082ed-c8ee-45df-9fa0-01cf58623ab0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.146062 Aug 10 17:01:52.773834 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 465/913] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:52 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:53.150803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c904aba3-c3b6-4f8d-a4b7-6f9662d1bc87 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:53.151416 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c904aba3-c3b6-4f8d-a4b7-6f9662d1bc87 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:53.157862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c904aba3-c3b6-4f8d-a4b7-6f9662d1bc87 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:53.158346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c904aba3-c3b6-4f8d-a4b7-6f9662d1bc87 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:53.158780 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c904aba3-c3b6-4f8d-a4b7-6f9662d1bc87 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:53.159466 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c904aba3-c3b6-4f8d-a4b7-6f9662d1bc87 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:53.159919 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c904aba3-c3b6-4f8d-a4b7-6f9662d1bc87 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:53.160383 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c904aba3-c3b6-4f8d-a4b7-6f9662d1bc87 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:53.294128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c904aba3-c3b6-4f8d-a4b7-6f9662d1bc87 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:53.301655 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c904aba3-c3b6-4f8d-a4b7-6f9662d1bc87 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.154660 Aug 10 17:01:53.302223 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 449/914] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:53 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:53.794739 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5d73dc1a-2f7a-45a3-ac85-be7cec16302a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:53.795361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5d73dc1a-2f7a-45a3-ac85-be7cec16302a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:53.801576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d73dc1a-2f7a-45a3-ac85-be7cec16302a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:53.802053 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d73dc1a-2f7a-45a3-ac85-be7cec16302a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:53.802492 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d73dc1a-2f7a-45a3-ac85-be7cec16302a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:53.803165 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d73dc1a-2f7a-45a3-ac85-be7cec16302a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:53.803608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d73dc1a-2f7a-45a3-ac85-be7cec16302a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:53.804023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d73dc1a-2f7a-45a3-ac85-be7cec16302a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:53.927109 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5d73dc1a-2f7a-45a3-ac85-be7cec16302a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:53.935002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5d73dc1a-2f7a-45a3-ac85-be7cec16302a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.144204 Aug 10 17:01:53.935562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 466/915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:53 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:54.323381 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e1a2de1-b932-42f2-9248-9fb145f2ab61 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:54.324108 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e1a2de1-b932-42f2-9248-9fb145f2ab61 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:54.330622 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e1a2de1-b932-42f2-9248-9fb145f2ab61 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:54.331230 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e1a2de1-b932-42f2-9248-9fb145f2ab61 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:54.331736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e1a2de1-b932-42f2-9248-9fb145f2ab61 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:54.332539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e1a2de1-b932-42f2-9248-9fb145f2ab61 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:54.333066 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e1a2de1-b932-42f2-9248-9fb145f2ab61 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:54.333500 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e1a2de1-b932-42f2-9248-9fb145f2ab61 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:54.614280 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9e1a2de1-b932-42f2-9248-9fb145f2ab61 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:54.622391 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e1a2de1-b932-42f2-9248-9fb145f2ab61 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.303648 Aug 10 17:01:54.622943 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 450/916] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:54 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:01:54.956728 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ad391215-48bf-4995-b10f-dcd43de450dd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:54.957326 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ad391215-48bf-4995-b10f-dcd43de450dd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:54.964504 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad391215-48bf-4995-b10f-dcd43de450dd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:54.964980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad391215-48bf-4995-b10f-dcd43de450dd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:54.965407 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad391215-48bf-4995-b10f-dcd43de450dd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:54.966088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad391215-48bf-4995-b10f-dcd43de450dd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:54.966537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad391215-48bf-4995-b10f-dcd43de450dd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:54.966954 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad391215-48bf-4995-b10f-dcd43de450dd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:55.112452 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ad391215-48bf-4995-b10f-dcd43de450dd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:55.120302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ad391215-48bf-4995-b10f-dcd43de450dd tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.167420 Aug 10 17:01:55.120855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 467/917] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:54 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:55.642416 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a447de70-c547-4010-b521-d1138f275168 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:55.643022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a447de70-c547-4010-b521-d1138f275168 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:55.649043 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a447de70-c547-4010-b521-d1138f275168 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:55.649529 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a447de70-c547-4010-b521-d1138f275168 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:55.649963 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a447de70-c547-4010-b521-d1138f275168 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:55.650640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a447de70-c547-4010-b521-d1138f275168 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:55.651091 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a447de70-c547-4010-b521-d1138f275168 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:55.651511 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a447de70-c547-4010-b521-d1138f275168 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:55.780130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a447de70-c547-4010-b521-d1138f275168 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:55.787756 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a447de70-c547-4010-b521-d1138f275168 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.149154 Aug 10 17:01:55.788395 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 451/918] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:55 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:01:56.140984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b9fbb1e3-a5fe-4b55-9f7e-e62543264d71 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:56.141622 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b9fbb1e3-a5fe-4b55-9f7e-e62543264d71 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:56.148508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9fbb1e3-a5fe-4b55-9f7e-e62543264d71 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:56.148991 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9fbb1e3-a5fe-4b55-9f7e-e62543264d71 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:56.150095 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9fbb1e3-a5fe-4b55-9f7e-e62543264d71 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:56.150783 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9fbb1e3-a5fe-4b55-9f7e-e62543264d71 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:56.151236 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9fbb1e3-a5fe-4b55-9f7e-e62543264d71 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:56.151685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9fbb1e3-a5fe-4b55-9f7e-e62543264d71 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:56.211049 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:56.279491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b9fbb1e3-a5fe-4b55-9f7e-e62543264d71 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:56.287383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b9fbb1e3-a5fe-4b55-9f7e-e62543264d71 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1735 microversion: 2.1 time: 0.150261 Aug 10 17:01:56.287966 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 468/919] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:56 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:56.809410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c158a270-9f50-46c9-a03f-56e345102113 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:56.809934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c158a270-9f50-46c9-a03f-56e345102113 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:56.811858 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:56.812542 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:56.819226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c158a270-9f50-46c9-a03f-56e345102113 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:56.819701 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c158a270-9f50-46c9-a03f-56e345102113 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:56.820130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c158a270-9f50-46c9-a03f-56e345102113 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:56.820989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c158a270-9f50-46c9-a03f-56e345102113 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:56.821464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c158a270-9f50-46c9-a03f-56e345102113 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:56.821886 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c158a270-9f50-46c9-a03f-56e345102113 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:57.171834 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c158a270-9f50-46c9-a03f-56e345102113 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:57.179258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c158a270-9f50-46c9-a03f-56e345102113 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.374685 Aug 10 17:01:57.179818 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 452/920] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:56 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:01:57.308247 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a6972703-0095-4239-8955-d51072a5a104 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:57.308863 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a6972703-0095-4239-8955-d51072a5a104 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:57.315240 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6972703-0095-4239-8955-d51072a5a104 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:57.315721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6972703-0095-4239-8955-d51072a5a104 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:57.316170 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6972703-0095-4239-8955-d51072a5a104 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:57.316875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6972703-0095-4239-8955-d51072a5a104 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:57.317336 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6972703-0095-4239-8955-d51072a5a104 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:57.317761 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6972703-0095-4239-8955-d51072a5a104 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:57.449859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a6972703-0095-4239-8955-d51072a5a104 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:57.457698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a6972703-0095-4239-8955-d51072a5a104 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1715 microversion: 2.1 time: 0.153274 Aug 10 17:01:57.458257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 469/921] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:57 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:57.517203 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:57.517709 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:57.523507 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:57.523990 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:57.525003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:57.525688 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:57.526144 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:57.526569 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:57.606368 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] HTTP exception thrown: Cannot 'detach_volume' instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b while it is in vm_state rescued Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Request method failure captured: Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments/93282e50-d378-403c-adf8-0022ea8567cc HTTP/1.1 Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lh1I9b-kzb_slWPvAVutdni9VM3659dFbvGG7qTcP042PDQs7hDKYwoJmH321qx5VWPk96Wr1z1hO4peTcy8akv6z-FleuR3FxKhnCOsmN7o9e6S20CSWhLrQ8J54JBEp1JiIbuk9o27XYyUSIPF3W2AYMFe1yND8oP5BURIf_OIQ Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: 36cf7bbfa5d3420996a2af036cf8e0da Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:01:57.608001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:01:57.609695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36cf7bbfa5d3420996a2af036cf8e0da", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:01:57.609695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:01:57.609695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: 36cf7bbfa5d3420996a2af036cf8e0da Aug 10 17:01:57.609695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:01:57.609695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-ServerRescueNegativeTestJSON-1943156217-project Aug 10 17:01:57.609695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:01:57.609695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:01:57.609695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: c7fac765624c4e0b85b01f356a14a1cb Aug 10 17:01:57.609695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1943156217-project Aug 10 17:01:57.609695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:01:57.609695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Cannot 'detach_volume' instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b while it is in vm_state rescued Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'server_id': 'c5e3c08d-8649-4c99-8c7c-a57166ebc96b', 'id': '93282e50-d378-403c-adf8-0022ea8567cc'} Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:01:57.610439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b while it is in vm_state rescued Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b while it is in vm_state rescued Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:01:57.611733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Returning 409 to user: Cannot 'detach_volume' instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b while it is in vm_state rescued {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:01:57.612789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ebb7b68c-469f-4eca-89a8-affc9e54eab1 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments/93282e50-d378-403c-adf8-0022ea8567cc" status: 409 len: 152 microversion: 2.1 time: 0.096163 Aug 10 17:01:57.612789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 453/922] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 17:01:57 2022] DELETE /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments/93282e50-d378-403c-adf8-0022ea8567cc => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:01:57.618618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-104814a5-544d-411d-939a-3a9f17756860 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:01:57.619143 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-104814a5-544d-411d-939a-3a9f17756860 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:57.624959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-104814a5-544d-411d-939a-3a9f17756860 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:57.625435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-104814a5-544d-411d-939a-3a9f17756860 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:57.625863 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-104814a5-544d-411d-939a-3a9f17756860 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:57.626539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-104814a5-544d-411d-939a-3a9f17756860 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:57.626982 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-104814a5-544d-411d-939a-3a9f17756860 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:57.627396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-104814a5-544d-411d-939a-3a9f17756860 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:57.644134 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:57.692189 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-104814a5-544d-411d-939a-3a9f17756860 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "POST /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/action" status: 202 len: 0 microversion: 2.1 time: 0.077581 Aug 10 17:01:57.692805 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 470/923] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 17:01:57 2022] POST /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:01:57.701345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b3f18bde-3eb2-4cdf-acd6-15b090cd07aa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:57.701950 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b3f18bde-3eb2-4cdf-acd6-15b090cd07aa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:57.708375 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f18bde-3eb2-4cdf-acd6-15b090cd07aa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:57.708859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f18bde-3eb2-4cdf-acd6-15b090cd07aa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:57.709561 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f18bde-3eb2-4cdf-acd6-15b090cd07aa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:57.710267 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f18bde-3eb2-4cdf-acd6-15b090cd07aa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:57.710717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f18bde-3eb2-4cdf-acd6-15b090cd07aa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:57.711137 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f18bde-3eb2-4cdf-acd6-15b090cd07aa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:57.836700 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b3f18bde-3eb2-4cdf-acd6-15b090cd07aa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:57.844576 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b3f18bde-3eb2-4cdf-acd6-15b090cd07aa tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1723 microversion: 2.1 time: 0.146975 Aug 10 17:01:57.845138 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 454/924] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:57 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:58.200298 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-03fd8503-a9d1-4d65-b667-12116d290d3d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:58.200979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-03fd8503-a9d1-4d65-b667-12116d290d3d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:58.207001 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03fd8503-a9d1-4d65-b667-12116d290d3d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:58.207480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03fd8503-a9d1-4d65-b667-12116d290d3d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:58.207905 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03fd8503-a9d1-4d65-b667-12116d290d3d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:58.208611 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03fd8503-a9d1-4d65-b667-12116d290d3d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:58.209316 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03fd8503-a9d1-4d65-b667-12116d290d3d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:58.209732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03fd8503-a9d1-4d65-b667-12116d290d3d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:58.337500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-03fd8503-a9d1-4d65-b667-12116d290d3d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:58.344904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-03fd8503-a9d1-4d65-b667-12116d290d3d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.148923 Aug 10 17:01:58.345471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 471/925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:58 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:58.865626 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b62fb14-5684-4cdd-b7e4-fe550aaf082f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:58.866251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6b62fb14-5684-4cdd-b7e4-fe550aaf082f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:58.872839 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b62fb14-5684-4cdd-b7e4-fe550aaf082f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:58.873328 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b62fb14-5684-4cdd-b7e4-fe550aaf082f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:58.873767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b62fb14-5684-4cdd-b7e4-fe550aaf082f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:58.874468 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b62fb14-5684-4cdd-b7e4-fe550aaf082f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:58.874932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b62fb14-5684-4cdd-b7e4-fe550aaf082f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:58.875388 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b62fb14-5684-4cdd-b7e4-fe550aaf082f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:59.006928 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6b62fb14-5684-4cdd-b7e4-fe550aaf082f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:59.015293 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b62fb14-5684-4cdd-b7e4-fe550aaf082f tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1723 microversion: 2.1 time: 0.153574 Aug 10 17:01:59.015861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 455/926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:58 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:01:59.365648 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-16c11ca2-73ab-474e-9e34-a0ffc10f472a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:01:59.366262 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-16c11ca2-73ab-474e-9e34-a0ffc10f472a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:01:59.373030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16c11ca2-73ab-474e-9e34-a0ffc10f472a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:59.373520 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16c11ca2-73ab-474e-9e34-a0ffc10f472a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:59.373957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16c11ca2-73ab-474e-9e34-a0ffc10f472a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:59.374650 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16c11ca2-73ab-474e-9e34-a0ffc10f472a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:01:59.375104 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16c11ca2-73ab-474e-9e34-a0ffc10f472a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:01:59.375532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16c11ca2-73ab-474e-9e34-a0ffc10f472a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:01:59.513247 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-16c11ca2-73ab-474e-9e34-a0ffc10f472a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:01:59.520692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-16c11ca2-73ab-474e-9e34-a0ffc10f472a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.158907 Aug 10 17:01:59.521259 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 472/927] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:01:59 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:00.037080 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-decd9373-8914-4640-86ca-15e0ebbd5518 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:00.037691 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-decd9373-8914-4640-86ca-15e0ebbd5518 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:00.044719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-decd9373-8914-4640-86ca-15e0ebbd5518 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:00.045211 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-decd9373-8914-4640-86ca-15e0ebbd5518 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:00.045654 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-decd9373-8914-4640-86ca-15e0ebbd5518 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:00.046346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-decd9373-8914-4640-86ca-15e0ebbd5518 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:00.046805 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-decd9373-8914-4640-86ca-15e0ebbd5518 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:00.047251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-decd9373-8914-4640-86ca-15e0ebbd5518 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:00.177699 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-decd9373-8914-4640-86ca-15e0ebbd5518 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:00.185806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-decd9373-8914-4640-86ca-15e0ebbd5518 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1723 microversion: 2.1 time: 0.152542 Aug 10 17:02:00.186348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 456/928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:00 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:00.540871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c25b053e-7ea6-415a-b8bb-bccabf305666 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:00.541470 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c25b053e-7ea6-415a-b8bb-bccabf305666 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:00.547799 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c25b053e-7ea6-415a-b8bb-bccabf305666 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:00.548311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c25b053e-7ea6-415a-b8bb-bccabf305666 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:00.548742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c25b053e-7ea6-415a-b8bb-bccabf305666 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:00.549417 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c25b053e-7ea6-415a-b8bb-bccabf305666 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:00.549860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c25b053e-7ea6-415a-b8bb-bccabf305666 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:00.550274 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c25b053e-7ea6-415a-b8bb-bccabf305666 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:00.684392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c25b053e-7ea6-415a-b8bb-bccabf305666 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:00.691936 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c25b053e-7ea6-415a-b8bb-bccabf305666 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.154845 Aug 10 17:02:00.692545 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 473/929] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:00 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:01.206680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa3c5f4a-e5a2-4e22-a25d-70a09e7a33e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:01.207282 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aa3c5f4a-e5a2-4e22-a25d-70a09e7a33e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:01.213938 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa3c5f4a-e5a2-4e22-a25d-70a09e7a33e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:01.214414 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa3c5f4a-e5a2-4e22-a25d-70a09e7a33e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:01.214843 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa3c5f4a-e5a2-4e22-a25d-70a09e7a33e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:01.215535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa3c5f4a-e5a2-4e22-a25d-70a09e7a33e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:01.216065 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa3c5f4a-e5a2-4e22-a25d-70a09e7a33e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:01.216516 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa3c5f4a-e5a2-4e22-a25d-70a09e7a33e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:01.342556 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa3c5f4a-e5a2-4e22-a25d-70a09e7a33e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:01.350313 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa3c5f4a-e5a2-4e22-a25d-70a09e7a33e8 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1723 microversion: 2.1 time: 0.147491 Aug 10 17:02:01.350860 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 457/930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:01 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:01.713087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5bfdb24a-a6cd-4c50-b2e1-8082531a8ab1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:01.713687 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5bfdb24a-a6cd-4c50-b2e1-8082531a8ab1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:01.720029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bfdb24a-a6cd-4c50-b2e1-8082531a8ab1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:01.720535 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bfdb24a-a6cd-4c50-b2e1-8082531a8ab1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:01.720963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bfdb24a-a6cd-4c50-b2e1-8082531a8ab1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:01.721639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bfdb24a-a6cd-4c50-b2e1-8082531a8ab1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:01.722427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bfdb24a-a6cd-4c50-b2e1-8082531a8ab1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:01.722848 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bfdb24a-a6cd-4c50-b2e1-8082531a8ab1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:01.853765 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5bfdb24a-a6cd-4c50-b2e1-8082531a8ab1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:01.861109 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5bfdb24a-a6cd-4c50-b2e1-8082531a8ab1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.152585 Aug 10 17:02:01.861672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 474/931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:01 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:02.372427 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bd0a602e-cc0b-434e-865c-b7cf73473d83 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:02.373028 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bd0a602e-cc0b-434e-865c-b7cf73473d83 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:02.379217 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd0a602e-cc0b-434e-865c-b7cf73473d83 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:02.379693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd0a602e-cc0b-434e-865c-b7cf73473d83 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:02.380164 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd0a602e-cc0b-434e-865c-b7cf73473d83 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:02.380829 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd0a602e-cc0b-434e-865c-b7cf73473d83 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:02.381280 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd0a602e-cc0b-434e-865c-b7cf73473d83 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:02.381697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd0a602e-cc0b-434e-865c-b7cf73473d83 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:02.384831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:02.513095 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bd0a602e-cc0b-434e-865c-b7cf73473d83 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:02.520910 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bd0a602e-cc0b-434e-865c-b7cf73473d83 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1723 microversion: 2.1 time: 0.152912 Aug 10 17:02:02.521467 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 458/932] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:02 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:02.881338 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dc799231-2472-4d6a-86fd-63ec0a48eed0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:02.881928 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-dc799231-2472-4d6a-86fd-63ec0a48eed0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:02.888202 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc799231-2472-4d6a-86fd-63ec0a48eed0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:02.888678 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc799231-2472-4d6a-86fd-63ec0a48eed0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:02.889101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc799231-2472-4d6a-86fd-63ec0a48eed0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:02.889775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc799231-2472-4d6a-86fd-63ec0a48eed0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:02.890218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc799231-2472-4d6a-86fd-63ec0a48eed0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:02.890634 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc799231-2472-4d6a-86fd-63ec0a48eed0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:03.022018 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dc799231-2472-4d6a-86fd-63ec0a48eed0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:03.029762 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-dc799231-2472-4d6a-86fd-63ec0a48eed0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.152233 Aug 10 17:02:03.030316 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 475/933] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:02 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:03.541472 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3564d036-3968-4f9a-8200-e2433986a146 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:03.542072 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3564d036-3968-4f9a-8200-e2433986a146 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:03.548529 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3564d036-3968-4f9a-8200-e2433986a146 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:03.549021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3564d036-3968-4f9a-8200-e2433986a146 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:03.549462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3564d036-3968-4f9a-8200-e2433986a146 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:03.550162 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3564d036-3968-4f9a-8200-e2433986a146 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:03.550618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3564d036-3968-4f9a-8200-e2433986a146 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:03.551047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3564d036-3968-4f9a-8200-e2433986a146 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:03.681176 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-3564d036-3968-4f9a-8200-e2433986a146 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:03.688940 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3564d036-3968-4f9a-8200-e2433986a146 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1723 microversion: 2.1 time: 0.151389 Aug 10 17:02:03.689493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 459/934] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:03 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:03.877056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-88463681-9211-4a04-96df-eab697c280fb req-5b6a38b8-ff50-450a-a314-383367dfba3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca57c21-5ab9-42f0-ba5c-158b397c8223", "name": "network-vif-plugged", "status": "completed", "tag": "25c45962-3be8-4f45-8373-a67dfc93aa99"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:03.887908 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-88463681-9211-4a04-96df-eab697c280fb req-5b6a38b8-ff50-450a-a314-383367dfba3d service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:03.888622 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-88463681-9211-4a04-96df-eab697c280fb req-5b6a38b8-ff50-450a-a314-383367dfba3d service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:03.889113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-88463681-9211-4a04-96df-eab697c280fb req-5b6a38b8-ff50-450a-a314-383367dfba3d service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:03.901360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-88463681-9211-4a04-96df-eab697c280fb req-5b6a38b8-ff50-450a-a314-383367dfba3d service nova] Creating event network-vif-plugged:25c45962-3be8-4f45-8373-a67dfc93aa99 for instance cca57c21-5ab9-42f0-ba5c-158b397c8223 on hv-cinder-83602 Aug 10 17:02:03.906370 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-88463681-9211-4a04-96df-eab697c280fb req-5b6a38b8-ff50-450a-a314-383367dfba3d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032961 Aug 10 17:02:03.907126 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 476/935] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:04.049975 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab3e33f1-7b12-4e45-8070-77a45badfb6e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:04.050586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab3e33f1-7b12-4e45-8070-77a45badfb6e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:04.056924 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab3e33f1-7b12-4e45-8070-77a45badfb6e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:04.057407 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab3e33f1-7b12-4e45-8070-77a45badfb6e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:04.057838 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab3e33f1-7b12-4e45-8070-77a45badfb6e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:04.058519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab3e33f1-7b12-4e45-8070-77a45badfb6e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:04.058970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab3e33f1-7b12-4e45-8070-77a45badfb6e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:04.059387 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab3e33f1-7b12-4e45-8070-77a45badfb6e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:04.195504 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab3e33f1-7b12-4e45-8070-77a45badfb6e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:04.203995 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab3e33f1-7b12-4e45-8070-77a45badfb6e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.157821 Aug 10 17:02:04.204594 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 460/936] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:04 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:04.710473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d808f1ff-4d14-40b2-8ca8-ac49e2de9f9e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:04.711301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d808f1ff-4d14-40b2-8ca8-ac49e2de9f9e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:04.717898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d808f1ff-4d14-40b2-8ca8-ac49e2de9f9e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:04.718370 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d808f1ff-4d14-40b2-8ca8-ac49e2de9f9e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:04.718793 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d808f1ff-4d14-40b2-8ca8-ac49e2de9f9e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:04.719466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d808f1ff-4d14-40b2-8ca8-ac49e2de9f9e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:04.719909 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d808f1ff-4d14-40b2-8ca8-ac49e2de9f9e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:04.720362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d808f1ff-4d14-40b2-8ca8-ac49e2de9f9e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:04.904430 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d808f1ff-4d14-40b2-8ca8-ac49e2de9f9e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:04.912286 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d808f1ff-4d14-40b2-8ca8-ac49e2de9f9e tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1729 microversion: 2.1 time: 0.206132 Aug 10 17:02:04.912975 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 477/937] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:04 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:04.933051 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6491d631-8516-44b6-a05d-5c29046e02d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:04.933574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6491d631-8516-44b6-a05d-5c29046e02d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:04.939832 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6491d631-8516-44b6-a05d-5c29046e02d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:04.940369 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6491d631-8516-44b6-a05d-5c29046e02d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:04.940812 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6491d631-8516-44b6-a05d-5c29046e02d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:04.941508 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6491d631-8516-44b6-a05d-5c29046e02d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:04.941973 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6491d631-8516-44b6-a05d-5c29046e02d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:04.942405 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6491d631-8516-44b6-a05d-5c29046e02d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:05.017725 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6491d631-8516-44b6-a05d-5c29046e02d5 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088517 Aug 10 17:02:05.018316 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 461/938] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 10 17:02:04 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:05.224901 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b94421fb-8b73-408b-87f5-e8560c536719 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:05.225500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b94421fb-8b73-408b-87f5-e8560c536719 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:05.231337 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b94421fb-8b73-408b-87f5-e8560c536719 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:05.231816 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b94421fb-8b73-408b-87f5-e8560c536719 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:05.232286 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b94421fb-8b73-408b-87f5-e8560c536719 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:05.232967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b94421fb-8b73-408b-87f5-e8560c536719 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:05.233416 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b94421fb-8b73-408b-87f5-e8560c536719 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:05.233832 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b94421fb-8b73-408b-87f5-e8560c536719 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:05.363976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b94421fb-8b73-408b-87f5-e8560c536719 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:05.372030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b94421fb-8b73-408b-87f5-e8560c536719 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.150977 Aug 10 17:02:05.372615 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 478/939] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:05 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:05.876631 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-372b6c0d-ca46-4c43-905c-7c2f15dc55c1 req-398c4398-fcdd-4c18-9d00-62ef400b32e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e3c08d-8649-4c99-8c7c-a57166ebc96b", "tag": "6d51b077-087c-428f-af01-0240852d1af2"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:05.887170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-372b6c0d-ca46-4c43-905c-7c2f15dc55c1 req-398c4398-fcdd-4c18-9d00-62ef400b32e9 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:05.887656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-372b6c0d-ca46-4c43-905c-7c2f15dc55c1 req-398c4398-fcdd-4c18-9d00-62ef400b32e9 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:05.888094 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-372b6c0d-ca46-4c43-905c-7c2f15dc55c1 req-398c4398-fcdd-4c18-9d00-62ef400b32e9 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:05.902457 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-372b6c0d-ca46-4c43-905c-7c2f15dc55c1 req-398c4398-fcdd-4c18-9d00-62ef400b32e9 service nova] Creating event network-changed:6d51b077-087c-428f-af01-0240852d1af2 for instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b on hv-cinder-83602 Aug 10 17:02:05.907624 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-372b6c0d-ca46-4c43-905c-7c2f15dc55c1 req-398c4398-fcdd-4c18-9d00-62ef400b32e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034762 Aug 10 17:02:05.908426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 462/940] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:06.392961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-88055899-47df-47ff-b235-b32e6e3443da tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:06.393728 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-88055899-47df-47ff-b235-b32e6e3443da tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:06.401098 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88055899-47df-47ff-b235-b32e6e3443da tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:06.401661 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88055899-47df-47ff-b235-b32e6e3443da tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:06.402158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88055899-47df-47ff-b235-b32e6e3443da tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:06.402920 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88055899-47df-47ff-b235-b32e6e3443da tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:06.403456 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88055899-47df-47ff-b235-b32e6e3443da tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:06.404073 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88055899-47df-47ff-b235-b32e6e3443da tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:06.613867 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-88055899-47df-47ff-b235-b32e6e3443da tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:06.621327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-88055899-47df-47ff-b235-b32e6e3443da tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.232211 Aug 10 17:02:06.633869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 479/941] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:06 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:07.642587 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-39aace60-340b-4abb-9a69-4677b97a7aa0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:07.643279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-39aace60-340b-4abb-9a69-4677b97a7aa0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:07.650521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39aace60-340b-4abb-9a69-4677b97a7aa0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:07.651004 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39aace60-340b-4abb-9a69-4677b97a7aa0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:07.651436 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39aace60-340b-4abb-9a69-4677b97a7aa0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:07.652132 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39aace60-340b-4abb-9a69-4677b97a7aa0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:07.652609 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39aace60-340b-4abb-9a69-4677b97a7aa0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:07.653034 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39aace60-340b-4abb-9a69-4677b97a7aa0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:07.793906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-39aace60-340b-4abb-9a69-4677b97a7aa0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:07.802474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-39aace60-340b-4abb-9a69-4677b97a7aa0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1261 microversion: 2.1 time: 0.163976 Aug 10 17:02:07.803205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 463/942] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:07 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:07.921546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-2f64c04e-bc2e-4692-b11b-1db82129872c req-35286bdd-d81a-44a8-b2c1-09c8978577aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e3c08d-8649-4c99-8c7c-a57166ebc96b", "tag": "6d51b077-087c-428f-af01-0240852d1af2"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:07.931025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2f64c04e-bc2e-4692-b11b-1db82129872c req-35286bdd-d81a-44a8-b2c1-09c8978577aa service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:07.931494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2f64c04e-bc2e-4692-b11b-1db82129872c req-35286bdd-d81a-44a8-b2c1-09c8978577aa service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:07.931919 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2f64c04e-bc2e-4692-b11b-1db82129872c req-35286bdd-d81a-44a8-b2c1-09c8978577aa service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:07.942420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-2f64c04e-bc2e-4692-b11b-1db82129872c req-35286bdd-d81a-44a8-b2c1-09c8978577aa service nova] Creating event network-changed:6d51b077-087c-428f-af01-0240852d1af2 for instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b on hv-cinder-83602 Aug 10 17:02:07.947925 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-2f64c04e-bc2e-4692-b11b-1db82129872c req-35286bdd-d81a-44a8-b2c1-09c8978577aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030056 Aug 10 17:02:07.948514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 480/943] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:08.822793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f1520b6-9c78-4547-bc64-ba2169769f54 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:08.823429 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4f1520b6-9c78-4547-bc64-ba2169769f54 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:08.829793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1520b6-9c78-4547-bc64-ba2169769f54 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:08.830268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1520b6-9c78-4547-bc64-ba2169769f54 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:08.830699 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1520b6-9c78-4547-bc64-ba2169769f54 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:08.831385 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1520b6-9c78-4547-bc64-ba2169769f54 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:08.831832 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1520b6-9c78-4547-bc64-ba2169769f54 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:08.832278 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1520b6-9c78-4547-bc64-ba2169769f54 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:08.958577 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4f1520b6-9c78-4547-bc64-ba2169769f54 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:08.966191 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f1520b6-9c78-4547-bc64-ba2169769f54 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1445 microversion: 2.1 time: 0.147271 Aug 10 17:02:08.966742 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 464/944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:08 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1445 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:08.986518 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-36fa1be1-b3cd-451d-ad4a-1480e5e87ea4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:08.987203 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-36fa1be1-b3cd-451d-ad4a-1480e5e87ea4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:08.994493 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36fa1be1-b3cd-451d-ad4a-1480e5e87ea4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:08.994968 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36fa1be1-b3cd-451d-ad4a-1480e5e87ea4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:08.995389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36fa1be1-b3cd-451d-ad4a-1480e5e87ea4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:08.996061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36fa1be1-b3cd-451d-ad4a-1480e5e87ea4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:08.996550 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36fa1be1-b3cd-451d-ad4a-1480e5e87ea4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:08.996947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36fa1be1-b3cd-451d-ad4a-1480e5e87ea4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:09.127838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-36fa1be1-b3cd-451d-ad4a-1480e5e87ea4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:09.135453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-36fa1be1-b3cd-451d-ad4a-1480e5e87ea4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1445 microversion: 2.1 time: 0.153145 Aug 10 17:02:09.136013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 481/945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:08 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:09.709961 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d8ead68-e887-4433-871d-15e2e6acf59f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:09.710452 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d8ead68-e887-4433-871d-15e2e6acf59f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:09.716937 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d8ead68-e887-4433-871d-15e2e6acf59f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:09.717458 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d8ead68-e887-4433-871d-15e2e6acf59f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:09.717892 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d8ead68-e887-4433-871d-15e2e6acf59f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:09.718576 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d8ead68-e887-4433-871d-15e2e6acf59f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:09.719028 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d8ead68-e887-4433-871d-15e2e6acf59f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:09.719453 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d8ead68-e887-4433-871d-15e2e6acf59f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:09.801429 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-8d8ead68-e887-4433-871d-15e2e6acf59f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lazy-loading 'services' on Instance uuid 2a08fd38-1ced-4301-a089-e789299f3104 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:02:09.878011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d8ead68-e887-4433-871d-15e2e6acf59f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/os-volume_attachments/199101e4-ff45-4c96-9d0d-3ea8904fb305" status: 202 len: 0 microversion: 2.1 time: 0.172082 Aug 10 17:02:09.878666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 465/946] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 17:02:09 2022] DELETE /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/os-volume_attachments/199101e4-ff45-4c96-9d0d-3ea8904fb305 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:02:10.969068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-1c1819ef-a73d-48a1-8327-b926ad3e8946 req-13aa3848-7e12-45c5-ad27-b2df12f05706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca57c21-5ab9-42f0-ba5c-158b397c8223", "tag": "25c45962-3be8-4f45-8373-a67dfc93aa99"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:10.975368 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=57 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:10.980871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-1c1819ef-a73d-48a1-8327-b926ad3e8946 req-13aa3848-7e12-45c5-ad27-b2df12f05706 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:10.981359 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-1c1819ef-a73d-48a1-8327-b926ad3e8946 req-13aa3848-7e12-45c5-ad27-b2df12f05706 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:10.981785 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-1c1819ef-a73d-48a1-8327-b926ad3e8946 req-13aa3848-7e12-45c5-ad27-b2df12f05706 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:10.993449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-1c1819ef-a73d-48a1-8327-b926ad3e8946 req-13aa3848-7e12-45c5-ad27-b2df12f05706 service nova] Creating event network-changed:25c45962-3be8-4f45-8373-a67dfc93aa99 for instance cca57c21-5ab9-42f0-ba5c-158b397c8223 on hv-cinder-83602 Aug 10 17:02:10.998301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-1c1819ef-a73d-48a1-8327-b926ad3e8946 req-13aa3848-7e12-45c5-ad27-b2df12f05706 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032780 Aug 10 17:02:10.999238 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 482/947] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:12.063382 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08eb642c-5a8b-45c4-a014-02036da0e235 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:12.065833 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:12.071243 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08eb642c-5a8b-45c4-a014-02036da0e235 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:12.071726 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08eb642c-5a8b-45c4-a014-02036da0e235 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:12.072173 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08eb642c-5a8b-45c4-a014-02036da0e235 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:12.094823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08eb642c-5a8b-45c4-a014-02036da0e235 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Going to try to stop instance {{(pid=120614) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 17:02:12.134673 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08eb642c-5a8b-45c4-a014-02036da0e235 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "POST /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/action" status: 202 len: 0 microversion: 2.1 time: 0.075307 Aug 10 17:02:12.135431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 466/948] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 17:02:12 2022] POST /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:02:12.144615 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4bb38585-e9fd-4713-90f6-97c55a704fcd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:12.145419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4bb38585-e9fd-4713-90f6-97c55a704fcd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:12.153061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb38585-e9fd-4713-90f6-97c55a704fcd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:12.153544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb38585-e9fd-4713-90f6-97c55a704fcd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:12.154247 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb38585-e9fd-4713-90f6-97c55a704fcd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:12.155495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb38585-e9fd-4713-90f6-97c55a704fcd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:12.155948 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb38585-e9fd-4713-90f6-97c55a704fcd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:12.156569 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb38585-e9fd-4713-90f6-97c55a704fcd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:12.284822 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4bb38585-e9fd-4713-90f6-97c55a704fcd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:12.293448 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4bb38585-e9fd-4713-90f6-97c55a704fcd tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.153718 Aug 10 17:02:12.294086 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 483/949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:12 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:13.315023 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-295896db-7a4b-4d8b-a4eb-78a42ec7048e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:13.315721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-295896db-7a4b-4d8b-a4eb-78a42ec7048e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:13.322320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-295896db-7a4b-4d8b-a4eb-78a42ec7048e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:13.322805 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-295896db-7a4b-4d8b-a4eb-78a42ec7048e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:13.323241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-295896db-7a4b-4d8b-a4eb-78a42ec7048e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:13.323933 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-295896db-7a4b-4d8b-a4eb-78a42ec7048e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:13.324425 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-295896db-7a4b-4d8b-a4eb-78a42ec7048e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:13.324857 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-295896db-7a4b-4d8b-a4eb-78a42ec7048e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:13.452430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-295896db-7a4b-4d8b-a4eb-78a42ec7048e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:13.460369 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-295896db-7a4b-4d8b-a4eb-78a42ec7048e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.149566 Aug 10 17:02:13.460923 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 467/950] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:13 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:14.480823 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1b0b7204-1201-44fa-a333-3c11aa6e5624 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:14.481425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1b0b7204-1201-44fa-a333-3c11aa6e5624 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:14.487720 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b0b7204-1201-44fa-a333-3c11aa6e5624 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:14.488222 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b0b7204-1201-44fa-a333-3c11aa6e5624 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:14.488653 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b0b7204-1201-44fa-a333-3c11aa6e5624 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:14.489421 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b0b7204-1201-44fa-a333-3c11aa6e5624 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:14.489869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b0b7204-1201-44fa-a333-3c11aa6e5624 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:14.490292 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b0b7204-1201-44fa-a333-3c11aa6e5624 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:14.619301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1b0b7204-1201-44fa-a333-3c11aa6e5624 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:14.626715 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1b0b7204-1201-44fa-a333-3c11aa6e5624 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.149855 Aug 10 17:02:14.627268 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 484/951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:14 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:15.648333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5034a17c-6ba9-4def-b98e-c6c4eeaf8c09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:15.648969 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5034a17c-6ba9-4def-b98e-c6c4eeaf8c09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:15.656060 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5034a17c-6ba9-4def-b98e-c6c4eeaf8c09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:15.656586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5034a17c-6ba9-4def-b98e-c6c4eeaf8c09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:15.657026 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5034a17c-6ba9-4def-b98e-c6c4eeaf8c09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:15.657722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5034a17c-6ba9-4def-b98e-c6c4eeaf8c09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:15.658178 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5034a17c-6ba9-4def-b98e-c6c4eeaf8c09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:15.658607 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5034a17c-6ba9-4def-b98e-c6c4eeaf8c09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:15.791424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5034a17c-6ba9-4def-b98e-c6c4eeaf8c09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:15.799006 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5034a17c-6ba9-4def-b98e-c6c4eeaf8c09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.154602 Aug 10 17:02:15.799574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 468/952] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:15 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:16.820458 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6630b678-83b8-4ae3-b196-1423e87331b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:16.821187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6630b678-83b8-4ae3-b196-1423e87331b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:16.827787 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6630b678-83b8-4ae3-b196-1423e87331b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:16.828311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6630b678-83b8-4ae3-b196-1423e87331b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:16.828742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6630b678-83b8-4ae3-b196-1423e87331b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:16.829428 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6630b678-83b8-4ae3-b196-1423e87331b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:16.829877 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6630b678-83b8-4ae3-b196-1423e87331b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:16.830293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6630b678-83b8-4ae3-b196-1423e87331b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:16.957084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6630b678-83b8-4ae3-b196-1423e87331b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:16.965290 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6630b678-83b8-4ae3-b196-1423e87331b4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.148670 Aug 10 17:02:16.965858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 485/953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:16 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:17.986506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8c77ca88-b9fb-4526-b723-ff015058003d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:17.987099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8c77ca88-b9fb-4526-b723-ff015058003d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:17.994218 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c77ca88-b9fb-4526-b723-ff015058003d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:17.994704 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c77ca88-b9fb-4526-b723-ff015058003d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:17.995138 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c77ca88-b9fb-4526-b723-ff015058003d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:17.995835 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c77ca88-b9fb-4526-b723-ff015058003d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:17.996327 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c77ca88-b9fb-4526-b723-ff015058003d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:17.996750 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c77ca88-b9fb-4526-b723-ff015058003d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:18.121709 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8c77ca88-b9fb-4526-b723-ff015058003d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:18.129058 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8c77ca88-b9fb-4526-b723-ff015058003d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.146602 Aug 10 17:02:18.129770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 469/954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:17 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:19.150141 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-280c65bd-8404-45ff-b5bb-c9f15363afe3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:19.150741 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-280c65bd-8404-45ff-b5bb-c9f15363afe3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:19.157066 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-280c65bd-8404-45ff-b5bb-c9f15363afe3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:19.157543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-280c65bd-8404-45ff-b5bb-c9f15363afe3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:19.157979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-280c65bd-8404-45ff-b5bb-c9f15363afe3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:19.158695 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-280c65bd-8404-45ff-b5bb-c9f15363afe3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:19.159087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-280c65bd-8404-45ff-b5bb-c9f15363afe3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:19.159504 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-280c65bd-8404-45ff-b5bb-c9f15363afe3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:19.284446 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-280c65bd-8404-45ff-b5bb-c9f15363afe3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:19.292227 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-280c65bd-8404-45ff-b5bb-c9f15363afe3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.146005 Aug 10 17:02:19.292783 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 486/955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:19 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:20.312731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-238f5a3e-239d-4133-86ad-cd0b99931ef4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:20.313373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-238f5a3e-239d-4133-86ad-cd0b99931ef4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:20.319815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-238f5a3e-239d-4133-86ad-cd0b99931ef4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:20.320344 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-238f5a3e-239d-4133-86ad-cd0b99931ef4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:20.320786 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-238f5a3e-239d-4133-86ad-cd0b99931ef4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:20.322104 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-238f5a3e-239d-4133-86ad-cd0b99931ef4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:20.322560 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-238f5a3e-239d-4133-86ad-cd0b99931ef4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:20.322988 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-238f5a3e-239d-4133-86ad-cd0b99931ef4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:20.452183 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-238f5a3e-239d-4133-86ad-cd0b99931ef4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:20.464262 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-238f5a3e-239d-4133-86ad-cd0b99931ef4 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.155387 Aug 10 17:02:20.464836 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 470/956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:20 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:21.485303 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c349a3b3-3f56-4340-a74d-dedb381f4ec3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:21.485912 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c349a3b3-3f56-4340-a74d-dedb381f4ec3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:21.491774 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c349a3b3-3f56-4340-a74d-dedb381f4ec3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:21.492297 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c349a3b3-3f56-4340-a74d-dedb381f4ec3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:21.492736 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c349a3b3-3f56-4340-a74d-dedb381f4ec3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:21.493972 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c349a3b3-3f56-4340-a74d-dedb381f4ec3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:21.494427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c349a3b3-3f56-4340-a74d-dedb381f4ec3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:21.494852 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c349a3b3-3f56-4340-a74d-dedb381f4ec3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:21.864122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c349a3b3-3f56-4340-a74d-dedb381f4ec3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:21.871479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c349a3b3-3f56-4340-a74d-dedb381f4ec3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.390158 Aug 10 17:02:21.872048 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 487/957] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:21 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:22.892249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a35f078a-3cf3-49a9-963a-4e9d2172413f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:22.892859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a35f078a-3cf3-49a9-963a-4e9d2172413f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:22.898849 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a35f078a-3cf3-49a9-963a-4e9d2172413f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:22.899986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a35f078a-3cf3-49a9-963a-4e9d2172413f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:22.900466 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a35f078a-3cf3-49a9-963a-4e9d2172413f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:22.901163 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a35f078a-3cf3-49a9-963a-4e9d2172413f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:22.901622 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a35f078a-3cf3-49a9-963a-4e9d2172413f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:22.902053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a35f078a-3cf3-49a9-963a-4e9d2172413f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:23.032007 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a35f078a-3cf3-49a9-963a-4e9d2172413f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:23.039391 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a35f078a-3cf3-49a9-963a-4e9d2172413f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.151217 Aug 10 17:02:23.040044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 471/958] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:22 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:24.043511 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2c59acb8-4eaa-453c-8be8-3e8aedac15a1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:24.044058 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2c59acb8-4eaa-453c-8be8-3e8aedac15a1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:24.050376 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c59acb8-4eaa-453c-8be8-3e8aedac15a1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:24.050853 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c59acb8-4eaa-453c-8be8-3e8aedac15a1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:24.051279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c59acb8-4eaa-453c-8be8-3e8aedac15a1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:24.051954 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c59acb8-4eaa-453c-8be8-3e8aedac15a1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:24.052421 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c59acb8-4eaa-453c-8be8-3e8aedac15a1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:24.052841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2c59acb8-4eaa-453c-8be8-3e8aedac15a1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:24.056550 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:24.059873 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e56c2ed-b69b-4321-887b-6d608cdba7fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:24.060514 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e56c2ed-b69b-4321-887b-6d608cdba7fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:24.066818 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e56c2ed-b69b-4321-887b-6d608cdba7fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:24.067305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e56c2ed-b69b-4321-887b-6d608cdba7fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:24.067741 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e56c2ed-b69b-4321-887b-6d608cdba7fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:24.068464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e56c2ed-b69b-4321-887b-6d608cdba7fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:24.068920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e56c2ed-b69b-4321-887b-6d608cdba7fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:24.069347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e56c2ed-b69b-4321-887b-6d608cdba7fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:24.077177 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2c59acb8-4eaa-453c-8be8-3e8aedac15a1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9/ips" status: 200 len: 149 microversion: 2.1 time: 0.037985 Aug 10 17:02:24.077744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 488/959] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 10 17:02:24 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:24.089676 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb2a23ae-927d-4e24-bc6d-dcbd254e25de"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:24.092050 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:24.099208 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:24.099685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:24.100112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:24.100824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:24.101274 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:24.101698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:24.181544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Invalid volume: volume bb2a23ae-927d-4e24-bc6d-dcbd254e25de is already attached to instances: 993a10bf-b49d-4027-b117-d167712152e0 Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: POST /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9/os-volume_attachments HTTP/1.1 Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 74 Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:02:24.183265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {"volumeAttachment": {"volumeId": "bb2a23ae-927d-4e24-bc6d-dcbd254e25de"}} Aug 10 17:02:24.184915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Invalid volume: volume bb2a23ae-927d-4e24-bc6d-dcbd254e25de is already attached to instances: 993a10bf-b49d-4027-b117-d167712152e0 Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'server_id': '43ed24c9-1f9e-48fa-94f0-773f2963e5b9', 'body': {'volumeAttachment': {'volumeId': 'bb2a23ae-927d-4e24-bc6d-dcbd254e25de'}}} Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bb2a23ae-927d-4e24-bc6d-dcbd254e25de is already attached to instances: 993a10bf-b49d-4027-b117-d167712152e0 Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:24.185794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bb2a23ae-927d-4e24-bc6d-dcbd254e25de is already attached to instances: 993a10bf-b49d-4027-b117-d167712152e0 Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:24.187242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:02:24.189328 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:02:24.189328 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:02:24.189328 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:02:24.189328 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bb2a23ae-927d-4e24-bc6d-dcbd254e25de is already attached to instances: 993a10bf-b49d-4027-b117-d167712152e0 Aug 10 17:02:24.189328 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:24.189328 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 400 to user: Invalid volume: volume bb2a23ae-927d-4e24-bc6d-dcbd254e25de is already attached to instances: 993a10bf-b49d-4027-b117-d167712152e0 {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:02:24.189328 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1a19acbc-d152-40ac-9562-3d513947985a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099593 Aug 10 17:02:24.189328 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 489/960] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 17:02:24 2022] POST /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 17:02:24.196703 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-627b1a55-e043-4ed7-bf40-663124f34592 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:24.197193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-627b1a55-e043-4ed7-bf40-663124f34592 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:24.202854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9e56c2ed-b69b-4321-887b-6d608cdba7fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:24.203800 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-627b1a55-e043-4ed7-bf40-663124f34592 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:24.204366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-627b1a55-e043-4ed7-bf40-663124f34592 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:24.204802 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-627b1a55-e043-4ed7-bf40-663124f34592 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:24.205497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-627b1a55-e043-4ed7-bf40-663124f34592 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:24.205945 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-627b1a55-e043-4ed7-bf40-663124f34592 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:24.206367 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-627b1a55-e043-4ed7-bf40-663124f34592 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:24.210798 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e56c2ed-b69b-4321-887b-6d608cdba7fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.155090 Aug 10 17:02:24.211367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 472/961] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:24 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:02:24.231646 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-627b1a55-e043-4ed7-bf40-663124f34592 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:02:24.305494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-627b1a55-e043-4ed7-bf40-663124f34592 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 204 len: 0 microversion: 2.1 time: 0.112088 Aug 10 17:02:24.305990 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 490/962] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:02:24 2022] DELETE /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:02:24.314924 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b73d5bc2-a3ff-4a60-a36b-e19704f1d36f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:24.315643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b73d5bc2-a3ff-4a60-a36b-e19704f1d36f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:24.321636 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b73d5bc2-a3ff-4a60-a36b-e19704f1d36f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:24.322118 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b73d5bc2-a3ff-4a60-a36b-e19704f1d36f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:24.322567 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b73d5bc2-a3ff-4a60-a36b-e19704f1d36f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:24.323295 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b73d5bc2-a3ff-4a60-a36b-e19704f1d36f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:24.323750 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b73d5bc2-a3ff-4a60-a36b-e19704f1d36f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:24.324200 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b73d5bc2-a3ff-4a60-a36b-e19704f1d36f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:24.452902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b73d5bc2-a3ff-4a60-a36b-e19704f1d36f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:24.460539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b73d5bc2-a3ff-4a60-a36b-e19704f1d36f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1681 microversion: 2.1 time: 0.149486 Aug 10 17:02:24.461104 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 473/963] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:24 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:25.233417 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-639f4f5b-5283-48cf-a960-30df1f6f4a4f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:25.234105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-639f4f5b-5283-48cf-a960-30df1f6f4a4f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:25.240571 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-639f4f5b-5283-48cf-a960-30df1f6f4a4f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:25.241053 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-639f4f5b-5283-48cf-a960-30df1f6f4a4f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:25.241486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-639f4f5b-5283-48cf-a960-30df1f6f4a4f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:25.242174 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-639f4f5b-5283-48cf-a960-30df1f6f4a4f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:25.242622 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-639f4f5b-5283-48cf-a960-30df1f6f4a4f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:25.243040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-639f4f5b-5283-48cf-a960-30df1f6f4a4f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:25.369013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-639f4f5b-5283-48cf-a960-30df1f6f4a4f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:25.377114 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-639f4f5b-5283-48cf-a960-30df1f6f4a4f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.148423 Aug 10 17:02:25.377680 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 491/964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:25 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:25.482160 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-00693ce7-3e77-44f7-aa60-dc24060e7790 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:25.482742 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-00693ce7-3e77-44f7-aa60-dc24060e7790 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:25.489261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00693ce7-3e77-44f7-aa60-dc24060e7790 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:25.489746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00693ce7-3e77-44f7-aa60-dc24060e7790 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:25.490210 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00693ce7-3e77-44f7-aa60-dc24060e7790 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:25.490900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00693ce7-3e77-44f7-aa60-dc24060e7790 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:25.491354 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00693ce7-3e77-44f7-aa60-dc24060e7790 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:25.491780 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00693ce7-3e77-44f7-aa60-dc24060e7790 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:25.495733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:25.618479 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-00693ce7-3e77-44f7-aa60-dc24060e7790 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:25.625785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-00693ce7-3e77-44f7-aa60-dc24060e7790 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1681 microversion: 2.1 time: 0.148123 Aug 10 17:02:25.626352 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 474/965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:25 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:26.398094 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c0194ce6-5f2a-4ca3-aa19-685e1611a77d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:26.398695 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c0194ce6-5f2a-4ca3-aa19-685e1611a77d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:26.404959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0194ce6-5f2a-4ca3-aa19-685e1611a77d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:26.405435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0194ce6-5f2a-4ca3-aa19-685e1611a77d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:26.405864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0194ce6-5f2a-4ca3-aa19-685e1611a77d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:26.406544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0194ce6-5f2a-4ca3-aa19-685e1611a77d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:26.406994 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0194ce6-5f2a-4ca3-aa19-685e1611a77d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:26.407411 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0194ce6-5f2a-4ca3-aa19-685e1611a77d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:26.536816 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c0194ce6-5f2a-4ca3-aa19-685e1611a77d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:26.544267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c0194ce6-5f2a-4ca3-aa19-685e1611a77d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.150152 Aug 10 17:02:26.544831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 492/966] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:26 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:26.648833 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa8a61ca-2fad-4e45-8852-4ce451caa46d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:26.649360 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aa8a61ca-2fad-4e45-8852-4ce451caa46d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:26.655602 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8a61ca-2fad-4e45-8852-4ce451caa46d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:26.656090 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8a61ca-2fad-4e45-8852-4ce451caa46d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:26.656563 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8a61ca-2fad-4e45-8852-4ce451caa46d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:26.657252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8a61ca-2fad-4e45-8852-4ce451caa46d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:26.657707 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8a61ca-2fad-4e45-8852-4ce451caa46d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:26.658132 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa8a61ca-2fad-4e45-8852-4ce451caa46d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:26.794278 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa8a61ca-2fad-4e45-8852-4ce451caa46d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:26.801816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa8a61ca-2fad-4e45-8852-4ce451caa46d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1681 microversion: 2.1 time: 0.156876 Aug 10 17:02:26.802381 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 475/967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:26 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:27.566532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-977eea58-6ed2-4dba-8e17-f79b077a41e7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:27.567158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-977eea58-6ed2-4dba-8e17-f79b077a41e7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:27.574153 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-977eea58-6ed2-4dba-8e17-f79b077a41e7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:27.574709 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-977eea58-6ed2-4dba-8e17-f79b077a41e7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:27.575170 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-977eea58-6ed2-4dba-8e17-f79b077a41e7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:27.575855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-977eea58-6ed2-4dba-8e17-f79b077a41e7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:27.576347 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-977eea58-6ed2-4dba-8e17-f79b077a41e7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:27.576764 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-977eea58-6ed2-4dba-8e17-f79b077a41e7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:27.772167 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-977eea58-6ed2-4dba-8e17-f79b077a41e7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:27.780552 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-977eea58-6ed2-4dba-8e17-f79b077a41e7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.217891 Aug 10 17:02:27.781125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 493/968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:27 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:27.825535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86d9fe39-9c7c-4a66-93c9-8d3882ca413f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:27.826788 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-86d9fe39-9c7c-4a66-93c9-8d3882ca413f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:27.832523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86d9fe39-9c7c-4a66-93c9-8d3882ca413f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:27.833021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86d9fe39-9c7c-4a66-93c9-8d3882ca413f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:27.833457 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86d9fe39-9c7c-4a66-93c9-8d3882ca413f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:27.834403 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86d9fe39-9c7c-4a66-93c9-8d3882ca413f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:27.834858 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86d9fe39-9c7c-4a66-93c9-8d3882ca413f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:27.835279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86d9fe39-9c7c-4a66-93c9-8d3882ca413f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:27.903245 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-86d9fe39-9c7c-4a66-93c9-8d3882ca413f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:27.910823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86d9fe39-9c7c-4a66-93c9-8d3882ca413f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1613 microversion: 2.1 time: 0.089928 Aug 10 17:02:27.911527 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 476/969] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:27 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:28.120846 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-05efc018-1473-4f08-a484-b5c169bcbb29 req-37c183d3-6eaf-4690-9703-f72a30915358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ed24c9-1f9e-48fa-94f0-773f2963e5b9", "name": "network-vif-deleted", "tag": "e32f7fef-5326-4138-b204-5b508dd1425c"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:28.131587 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-05efc018-1473-4f08-a484-b5c169bcbb29 req-37c183d3-6eaf-4690-9703-f72a30915358 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:28.132342 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-05efc018-1473-4f08-a484-b5c169bcbb29 req-37c183d3-6eaf-4690-9703-f72a30915358 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:28.133004 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-05efc018-1473-4f08-a484-b5c169bcbb29 req-37c183d3-6eaf-4690-9703-f72a30915358 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:28.146254 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-05efc018-1473-4f08-a484-b5c169bcbb29 req-37c183d3-6eaf-4690-9703-f72a30915358 service nova] Creating event network-vif-deleted:e32f7fef-5326-4138-b204-5b508dd1425c for instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 on hv-cinder-83602 Aug 10 17:02:28.151179 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-05efc018-1473-4f08-a484-b5c169bcbb29 req-37c183d3-6eaf-4690-9703-f72a30915358 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034845 Aug 10 17:02:28.151760 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 494/970] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:28.802504 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-682cc1ff-7740-48eb-9f51-f36bb79cb11e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:28.803735 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-682cc1ff-7740-48eb-9f51-f36bb79cb11e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:28.810009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-682cc1ff-7740-48eb-9f51-f36bb79cb11e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:28.810589 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-682cc1ff-7740-48eb-9f51-f36bb79cb11e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:28.811647 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-682cc1ff-7740-48eb-9f51-f36bb79cb11e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:28.812466 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-682cc1ff-7740-48eb-9f51-f36bb79cb11e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:28.813708 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-682cc1ff-7740-48eb-9f51-f36bb79cb11e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:28.814157 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-682cc1ff-7740-48eb-9f51-f36bb79cb11e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:28.934023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:28.935246 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:28.949015 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:28.952459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:28.953174 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:28.953960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:28.954432 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:28.954876 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:29.010987 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-682cc1ff-7740-48eb-9f51-f36bb79cb11e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:29.015557 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:29.015912 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:29.017132 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:29.017977 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lazy-loading 'fault' on Instance uuid 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:02:29.034402 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-682cc1ff-7740-48eb-9f51-f36bb79cb11e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.235706 Aug 10 17:02:29.034991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 477/971] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:28 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:29.089737 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:29.097389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-785d34f5-21ba-4d21-a05c-bd74dde20780 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 200 len: 1331 microversion: 2.1 time: 0.169074 Aug 10 17:02:29.097976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 495/972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:28 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 1331 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:30.069291 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2cf4cb77-3994-47d9-9183-aacf1d980efb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:30.069908 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2cf4cb77-3994-47d9-9183-aacf1d980efb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:30.077349 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2cf4cb77-3994-47d9-9183-aacf1d980efb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:30.078215 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2cf4cb77-3994-47d9-9183-aacf1d980efb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:30.079098 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2cf4cb77-3994-47d9-9183-aacf1d980efb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:30.079826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2cf4cb77-3994-47d9-9183-aacf1d980efb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:30.080326 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2cf4cb77-3994-47d9-9183-aacf1d980efb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:30.080765 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2cf4cb77-3994-47d9-9183-aacf1d980efb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:30.118319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:30.119027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:30.125872 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:30.126463 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:30.126966 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:30.127736 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:30.128299 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:30.128810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:30.142696 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 HTTP/1.1 Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:02:30.144537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:02:30.145860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '43ed24c9-1f9e-48fa-94f0-773f2963e5b9'} Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:02:30.146593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:02:30.147812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:30.148969 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:02:30.148969 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c172b755-7e46-467b-b9c2-f8c3a68e6ed3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 404 len: 111 microversion: 2.1 time: 0.031456 Aug 10 17:02:30.148969 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 496/973] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:30 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:02:30.155282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8fe226ea-5d21-4cc1-a349-044030a39ea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '.version_select at 0x7f5b0caa1160>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:30.181677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8fe226ea-5d21-4cc1-a349-044030a39ea6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857236865" status: 202 len: 0 microversion: 2.1 time: 0.030439 Aug 10 17:02:30.184196 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 497/974] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Aug 10 17:02:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857236865 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:02:30.224473 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2cf4cb77-3994-47d9-9183-aacf1d980efb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:30.232876 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2cf4cb77-3994-47d9-9183-aacf1d980efb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.167466 Aug 10 17:02:30.233676 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 478/975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:30 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:30.828154 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a598895b-7269-4004-a0f8-cd5b07063cb3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:30.828657 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a598895b-7269-4004-a0f8-cd5b07063cb3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:30.835471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a598895b-7269-4004-a0f8-cd5b07063cb3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:30.835942 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a598895b-7269-4004-a0f8-cd5b07063cb3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:30.836401 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a598895b-7269-4004-a0f8-cd5b07063cb3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:30.837075 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a598895b-7269-4004-a0f8-cd5b07063cb3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:30.837517 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a598895b-7269-4004-a0f8-cd5b07063cb3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:30.837931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a598895b-7269-4004-a0f8-cd5b07063cb3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:30.965978 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-a598895b-7269-4004-a0f8-cd5b07063cb3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lazy-loading 'services' on Instance uuid 993a10bf-b49d-4027-b117-d167712152e0 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:02:31.078749 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a598895b-7269-4004-a0f8-cd5b07063cb3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-volume_attachments/bb2a23ae-927d-4e24-bc6d-dcbd254e25de" status: 202 len: 0 microversion: 2.1 time: 0.254191 Aug 10 17:02:31.079536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 498/976] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 17:02:30 2022] DELETE /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-volume_attachments/bb2a23ae-927d-4e24-bc6d-dcbd254e25de => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:02:31.088035 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-43b8a058-d83e-45bc-8297-d5bb8896302b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:31.090320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-43b8a058-d83e-45bc-8297-d5bb8896302b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:31.096749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43b8a058-d83e-45bc-8297-d5bb8896302b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:31.097198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43b8a058-d83e-45bc-8297-d5bb8896302b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:31.097627 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43b8a058-d83e-45bc-8297-d5bb8896302b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:31.098317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43b8a058-d83e-45bc-8297-d5bb8896302b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:31.098773 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43b8a058-d83e-45bc-8297-d5bb8896302b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:31.099197 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43b8a058-d83e-45bc-8297-d5bb8896302b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:31.129428 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-43b8a058-d83e-45bc-8297-d5bb8896302b tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045469 Aug 10 17:02:31.129971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 479/977] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:02:31 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:31.254062 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-613ac77d-2a2b-4a8a-886a-f52180dca842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:31.254751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-613ac77d-2a2b-4a8a-886a-f52180dca842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:31.261704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-613ac77d-2a2b-4a8a-886a-f52180dca842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:31.262167 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-613ac77d-2a2b-4a8a-886a-f52180dca842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:31.262590 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-613ac77d-2a2b-4a8a-886a-f52180dca842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:31.263268 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-613ac77d-2a2b-4a8a-886a-f52180dca842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:31.263713 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-613ac77d-2a2b-4a8a-886a-f52180dca842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:31.264131 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-613ac77d-2a2b-4a8a-886a-f52180dca842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:31.399146 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-613ac77d-2a2b-4a8a-886a-f52180dca842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:31.406581 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-613ac77d-2a2b-4a8a-886a-f52180dca842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.156703 Aug 10 17:02:31.407139 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 499/978] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:31 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:32.142196 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72808ab0-27ca-4878-b528-d5faf3d3e80d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:32.144324 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-72808ab0-27ca-4878-b528-d5faf3d3e80d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:32.151479 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72808ab0-27ca-4878-b528-d5faf3d3e80d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:32.152013 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72808ab0-27ca-4878-b528-d5faf3d3e80d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:32.152486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72808ab0-27ca-4878-b528-d5faf3d3e80d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:32.153184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72808ab0-27ca-4878-b528-d5faf3d3e80d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:32.153672 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72808ab0-27ca-4878-b528-d5faf3d3e80d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:32.154105 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72808ab0-27ca-4878-b528-d5faf3d3e80d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:32.182033 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-72808ab0-27ca-4878-b528-d5faf3d3e80d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Aug 10 17:02:32.182596 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 480/979] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:02:32 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:32.429107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2ddffdea-f34a-40dc-8534-19e584082c87 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:32.429616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2ddffdea-f34a-40dc-8534-19e584082c87 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:32.436480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ddffdea-f34a-40dc-8534-19e584082c87 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:32.436961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ddffdea-f34a-40dc-8534-19e584082c87 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:32.437389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ddffdea-f34a-40dc-8534-19e584082c87 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:32.438070 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ddffdea-f34a-40dc-8534-19e584082c87 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:32.438516 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ddffdea-f34a-40dc-8534-19e584082c87 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:32.438934 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ddffdea-f34a-40dc-8534-19e584082c87 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:32.565812 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2ddffdea-f34a-40dc-8534-19e584082c87 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:32.573777 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2ddffdea-f34a-40dc-8534-19e584082c87 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1678 microversion: 2.1 time: 0.148660 Aug 10 17:02:32.574337 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 500/980] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:32 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:33.194448 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79e84370-2c3a-476a-a027-1b73d4caa7f3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:33.196657 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-79e84370-2c3a-476a-a027-1b73d4caa7f3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:33.203249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79e84370-2c3a-476a-a027-1b73d4caa7f3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:33.203734 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79e84370-2c3a-476a-a027-1b73d4caa7f3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:33.204191 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79e84370-2c3a-476a-a027-1b73d4caa7f3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:33.204888 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79e84370-2c3a-476a-a027-1b73d4caa7f3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:33.205343 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79e84370-2c3a-476a-a027-1b73d4caa7f3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:33.205771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79e84370-2c3a-476a-a027-1b73d4caa7f3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:33.234951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79e84370-2c3a-476a-a027-1b73d4caa7f3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044468 Aug 10 17:02:33.235498 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 481/981] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:02:33 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:02:33.295579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-260c0f03-d6e9-474c-839d-dbb0d6eb9667 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:33.296105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-260c0f03-d6e9-474c-839d-dbb0d6eb9667 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:33.301969 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-260c0f03-d6e9-474c-839d-dbb0d6eb9667 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:33.302446 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-260c0f03-d6e9-474c-839d-dbb0d6eb9667 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:33.302875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-260c0f03-d6e9-474c-839d-dbb0d6eb9667 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:33.303554 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-260c0f03-d6e9-474c-839d-dbb0d6eb9667 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:33.304004 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-260c0f03-d6e9-474c-839d-dbb0d6eb9667 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:33.304467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-260c0f03-d6e9-474c-839d-dbb0d6eb9667 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:33.328869 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-260c0f03-d6e9-474c-839d-dbb0d6eb9667 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:02:33.406473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-260c0f03-d6e9-474c-839d-dbb0d6eb9667 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 204 len: 0 microversion: 2.1 time: 0.115068 Aug 10 17:02:33.407536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 501/982] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:02:33 2022] DELETE /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:02:33.416867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d2b4712-d30b-4dbf-8c81-1e3514274969 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:33.417079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d2b4712-d30b-4dbf-8c81-1e3514274969 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:33.423006 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2b4712-d30b-4dbf-8c81-1e3514274969 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:33.427666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2b4712-d30b-4dbf-8c81-1e3514274969 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:33.428116 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2b4712-d30b-4dbf-8c81-1e3514274969 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:33.428859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2b4712-d30b-4dbf-8c81-1e3514274969 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:33.429319 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2b4712-d30b-4dbf-8c81-1e3514274969 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:33.429744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2b4712-d30b-4dbf-8c81-1e3514274969 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:33.555750 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d2b4712-d30b-4dbf-8c81-1e3514274969 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:33.563223 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d2b4712-d30b-4dbf-8c81-1e3514274969 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1679 microversion: 2.1 time: 0.151100 Aug 10 17:02:33.563808 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 482/983] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:33 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:02:33.595836 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6d63c94f-d3bf-45f5-91c8-a4be80c57692 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:33.596611 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6d63c94f-d3bf-45f5-91c8-a4be80c57692 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:33.602802 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d63c94f-d3bf-45f5-91c8-a4be80c57692 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:33.603280 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d63c94f-d3bf-45f5-91c8-a4be80c57692 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:33.603737 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d63c94f-d3bf-45f5-91c8-a4be80c57692 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:33.604495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d63c94f-d3bf-45f5-91c8-a4be80c57692 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:33.604939 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d63c94f-d3bf-45f5-91c8-a4be80c57692 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:33.605352 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d63c94f-d3bf-45f5-91c8-a4be80c57692 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:33.733007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6d63c94f-d3bf-45f5-91c8-a4be80c57692 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:33.740396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6d63c94f-d3bf-45f5-91c8-a4be80c57692 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1655 microversion: 2.1 time: 0.148655 Aug 10 17:02:33.740955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 502/984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:33 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:33.761426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79c16c99-234f-4e83-812d-83aeb70d61eb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:33.767262 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79c16c99-234f-4e83-812d-83aeb70d61eb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:33.767749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79c16c99-234f-4e83-812d-83aeb70d61eb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:33.768225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79c16c99-234f-4e83-812d-83aeb70d61eb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:33.789382 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-79c16c99-234f-4e83-812d-83aeb70d61eb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Going to try to start instance {{(pid=120614) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 17:02:33.829546 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79c16c99-234f-4e83-812d-83aeb70d61eb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "POST /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/action" status: 202 len: 0 microversion: 2.1 time: 0.072302 Aug 10 17:02:33.830130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 483/985] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 17:02:33 2022] POST /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:02:33.838570 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-debd23cc-3c3b-4d66-be4a-44de8329afb7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:33.839178 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-debd23cc-3c3b-4d66-be4a-44de8329afb7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:33.845004 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-debd23cc-3c3b-4d66-be4a-44de8329afb7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:33.845477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-debd23cc-3c3b-4d66-be4a-44de8329afb7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:33.845903 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-debd23cc-3c3b-4d66-be4a-44de8329afb7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:33.846580 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-debd23cc-3c3b-4d66-be4a-44de8329afb7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:33.847029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-debd23cc-3c3b-4d66-be4a-44de8329afb7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:33.847446 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-debd23cc-3c3b-4d66-be4a-44de8329afb7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:33.851344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:33.983947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-debd23cc-3c3b-4d66-be4a-44de8329afb7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:33.991230 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-debd23cc-3c3b-4d66-be4a-44de8329afb7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1664 microversion: 2.1 time: 0.156988 Aug 10 17:02:33.991785 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 503/986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:33 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:34.586122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-78221fc4-7780-4244-a75d-546305cde355 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:34.586816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-78221fc4-7780-4244-a75d-546305cde355 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:34.592880 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78221fc4-7780-4244-a75d-546305cde355 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:34.593367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78221fc4-7780-4244-a75d-546305cde355 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:34.593803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78221fc4-7780-4244-a75d-546305cde355 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:34.594489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78221fc4-7780-4244-a75d-546305cde355 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:34.594950 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78221fc4-7780-4244-a75d-546305cde355 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:34.595373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78221fc4-7780-4244-a75d-546305cde355 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:34.835562 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-78221fc4-7780-4244-a75d-546305cde355 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:34.843987 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-78221fc4-7780-4244-a75d-546305cde355 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1679 microversion: 2.1 time: 0.262849 Aug 10 17:02:34.844678 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 484/987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:34 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:35.011978 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5ff238e5-f4b0-4670-8520-68895ca4845e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:35.012593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5ff238e5-f4b0-4670-8520-68895ca4845e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:35.018924 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5ff238e5-f4b0-4670-8520-68895ca4845e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:35.019403 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5ff238e5-f4b0-4670-8520-68895ca4845e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:35.019831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5ff238e5-f4b0-4670-8520-68895ca4845e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:35.020538 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5ff238e5-f4b0-4670-8520-68895ca4845e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:35.021098 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5ff238e5-f4b0-4670-8520-68895ca4845e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:35.021525 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5ff238e5-f4b0-4670-8520-68895ca4845e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:35.149885 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5ff238e5-f4b0-4670-8520-68895ca4845e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:35.157150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5ff238e5-f4b0-4670-8520-68895ca4845e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1664 microversion: 2.1 time: 0.149068 Aug 10 17:02:35.157705 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 504/988] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:35 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1664 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:35.628852 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-11d9b732-4e52-4140-b347-aeaa9b721e24 req-a2aae77d-e1b0-4d1c-841e-2435eab7c819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993a10bf-b49d-4027-b117-d167712152e0", "name": "network-vif-deleted", "tag": "0a60f022-b759-4dc7-8144-208e6c5d1ad3"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:35.642905 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11d9b732-4e52-4140-b347-aeaa9b721e24 req-a2aae77d-e1b0-4d1c-841e-2435eab7c819 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:35.643483 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11d9b732-4e52-4140-b347-aeaa9b721e24 req-a2aae77d-e1b0-4d1c-841e-2435eab7c819 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:35.644326 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11d9b732-4e52-4140-b347-aeaa9b721e24 req-a2aae77d-e1b0-4d1c-841e-2435eab7c819 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:35.658964 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-11d9b732-4e52-4140-b347-aeaa9b721e24 req-a2aae77d-e1b0-4d1c-841e-2435eab7c819 service nova] Creating event network-vif-deleted:0a60f022-b759-4dc7-8144-208e6c5d1ad3 for instance 993a10bf-b49d-4027-b117-d167712152e0 on hv-cinder-83602 Aug 10 17:02:35.664342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-11d9b732-4e52-4140-b347-aeaa9b721e24 req-a2aae77d-e1b0-4d1c-841e-2435eab7c819 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039238 Aug 10 17:02:35.665204 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 485/989] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:35.865993 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6e831aae-dd48-4098-8db4-b041bb45afe8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:35.866373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6e831aae-dd48-4098-8db4-b041bb45afe8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:35.872199 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6e831aae-dd48-4098-8db4-b041bb45afe8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:35.872690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6e831aae-dd48-4098-8db4-b041bb45afe8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:35.873125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6e831aae-dd48-4098-8db4-b041bb45afe8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:35.873816 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6e831aae-dd48-4098-8db4-b041bb45afe8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:35.874266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6e831aae-dd48-4098-8db4-b041bb45afe8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:35.874687 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6e831aae-dd48-4098-8db4-b041bb45afe8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:35.937521 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6e831aae-dd48-4098-8db4-b041bb45afe8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:35.946167 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6e831aae-dd48-4098-8db4-b041bb45afe8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 200 len: 1612 microversion: 2.1 time: 0.084257 Aug 10 17:02:35.946787 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 505/990] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:35 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 1612 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:36.180241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-89b3f4a7-8d72-4c0b-bfe5-fb0bdbe4b570 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:36.181056 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-89b3f4a7-8d72-4c0b-bfe5-fb0bdbe4b570 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:36.188093 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89b3f4a7-8d72-4c0b-bfe5-fb0bdbe4b570 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:36.188622 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89b3f4a7-8d72-4c0b-bfe5-fb0bdbe4b570 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:36.189060 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89b3f4a7-8d72-4c0b-bfe5-fb0bdbe4b570 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:36.189755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89b3f4a7-8d72-4c0b-bfe5-fb0bdbe4b570 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:36.190208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89b3f4a7-8d72-4c0b-bfe5-fb0bdbe4b570 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:36.190823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89b3f4a7-8d72-4c0b-bfe5-fb0bdbe4b570 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:36.331935 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-89b3f4a7-8d72-4c0b-bfe5-fb0bdbe4b570 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:36.339992 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-89b3f4a7-8d72-4c0b-bfe5-fb0bdbe4b570 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1668 microversion: 2.1 time: 0.164150 Aug 10 17:02:36.340608 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 486/991] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:36 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:36.969440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:36.970049 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:36.976419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:36.976897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:36.977322 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:36.977997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:36.978440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:36.979544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:36.993741 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 HTTP/1.1 Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:02:36.995372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:02:36.997027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '993a10bf-b49d-4027-b117-d167712152e0'} Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:02:36.997960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:02:36.999462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:37.000855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:02:37.000855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-115bc094-55ca-43b2-aafe-9148219e91ea tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 404 len: 111 microversion: 2.1 time: 0.031224 Aug 10 17:02:37.000855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 506/992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:36 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:02:37.005772 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0fbe38a6-0801-4e14-828e-a44af2b880bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '.version_select at 0x7f5b08346550>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:37.025050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0fbe38a6-0801-4e14-828e-a44af2b880bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256132166" status: 202 len: 0 microversion: 2.1 time: 0.023015 Aug 10 17:02:37.026207 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 487/993] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Aug 10 17:02:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256132166 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:02:37.612294 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4086ceec-3e1a-4fed-8f1b-fe7184ac6cd4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: .version_select at 0x7f5b0c9959d0>, body: {"keypair": {"name": "tempest-keypair-2011495431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4Ql25SaK+sHetluGQlK4CEQJW0vArLObumZJ8Jj5FffUrFbmIQt4TbulMjIWqnj8XElu45duFtnl1/RjyxqaysRkkdAziQOosbAfdTZonYCJPYyWXAUyaLNolvKMT4VA=="}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:37.627915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-4086ceec-3e1a-4fed-8f1b-fe7184ac6cd4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:02:37.631680 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-4086ceec-3e1a-4fed-8f1b-fe7184ac6cd4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for user 7a701149974b45db9f782bc5a232aabe and project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:02:37.653252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4086ceec-3e1a-4fed-8f1b-fe7184ac6cd4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044778 Aug 10 17:02:37.653839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 507/994] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 10 17:02:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:38.892075 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-310420919", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbfebec6-8639-47f9-80f8-59f6b2be1e54"}], "security_groups": [{"name": "tempest-securitygroup--1182707867"}], "key_name": "tempest-keypair-2011495431", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:38.994030 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] validate_networks() for [('dbfebec6-8639-47f9-80f8-59f6b2be1e54', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:02:39.353596 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:02:39.354443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:02:39.354978 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:02:39.355384 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:02:39.355792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:02:39.364555 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:39.365035 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:39.365466 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:39.366185 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:39.366633 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:39.367056 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:39.382993 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:02:39.387321 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for user 7a701149974b45db9f782bc5a232aabe and project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:02:39.398092 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:02:39.400310 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:02:39.448010 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f94e57cb-5ab3-41b8-a2dc-dfa74da57fc7 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.560241 Aug 10 17:02:39.448682 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 488/995] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 17:02:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:02:39.460309 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cc61d512-5807-46bf-bc9c-96af19e6d5bb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:39.460909 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cc61d512-5807-46bf-bc9c-96af19e6d5bb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:39.516395 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cc61d512-5807-46bf-bc9c-96af19e6d5bb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:39.522986 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cc61d512-5807-46bf-bc9c-96af19e6d5bb tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1241 microversion: 2.1 time: 0.067412 Aug 10 17:02:39.523723 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 508/996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:39 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:40.545442 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2d6784a-d5c7-4684-a663-a2dadd38593f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:40.546848 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2d6784a-d5c7-4684-a663-a2dadd38593f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:40.554710 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2d6784a-d5c7-4684-a663-a2dadd38593f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:40.555144 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2d6784a-d5c7-4684-a663-a2dadd38593f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:40.555829 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2d6784a-d5c7-4684-a663-a2dadd38593f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:40.556669 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2d6784a-d5c7-4684-a663-a2dadd38593f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:40.557154 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2d6784a-d5c7-4684-a663-a2dadd38593f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:40.557584 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2d6784a-d5c7-4684-a663-a2dadd38593f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:40.630808 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2d6784a-d5c7-4684-a663-a2dadd38593f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:40.638946 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2d6784a-d5c7-4684-a663-a2dadd38593f tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1301 microversion: 2.1 time: 0.099153 Aug 10 17:02:40.642364 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 489/997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:40 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:41.662453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-19d9de65-bcef-4fad-bf49-76912a0c8971 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:41.663123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-19d9de65-bcef-4fad-bf49-76912a0c8971 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:41.665622 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:41.671762 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d9de65-bcef-4fad-bf49-76912a0c8971 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:41.672332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d9de65-bcef-4fad-bf49-76912a0c8971 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:41.672792 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d9de65-bcef-4fad-bf49-76912a0c8971 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:41.673497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d9de65-bcef-4fad-bf49-76912a0c8971 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:41.673955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d9de65-bcef-4fad-bf49-76912a0c8971 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:41.674364 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d9de65-bcef-4fad-bf49-76912a0c8971 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:41.818794 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-19d9de65-bcef-4fad-bf49-76912a0c8971 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:41.826651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-19d9de65-bcef-4fad-bf49-76912a0c8971 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1367 microversion: 2.1 time: 0.169106 Aug 10 17:02:41.827313 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 509/998] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:41 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:42.203498 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9e9fc35d-9992-48dd-a384-a793ab4a03ba req-8eed0513-5fba-42c6-a0c5-ba29132b92d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7432bd1c-aa00-4a08-95e9-63b9da22967f", "tag": "42838665-21f4-4962-979d-dee2bed7cf1f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:42.208919 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:42.216755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9e9fc35d-9992-48dd-a384-a793ab4a03ba req-8eed0513-5fba-42c6-a0c5-ba29132b92d8 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:42.217238 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9e9fc35d-9992-48dd-a384-a793ab4a03ba req-8eed0513-5fba-42c6-a0c5-ba29132b92d8 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:42.217671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9e9fc35d-9992-48dd-a384-a793ab4a03ba req-8eed0513-5fba-42c6-a0c5-ba29132b92d8 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:42.231499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9e9fc35d-9992-48dd-a384-a793ab4a03ba req-8eed0513-5fba-42c6-a0c5-ba29132b92d8 service nova] Creating event network-changed:42838665-21f4-4962-979d-dee2bed7cf1f for instance 7432bd1c-aa00-4a08-95e9-63b9da22967f on hv-cinder-83602 Aug 10 17:02:42.236473 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9e9fc35d-9992-48dd-a384-a793ab4a03ba req-8eed0513-5fba-42c6-a0c5-ba29132b92d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036578 Aug 10 17:02:42.237093 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 490/999] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:42.847887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2d53dab6-39dc-4839-9e93-8a41716c21b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:42.848525 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2d53dab6-39dc-4839-9e93-8a41716c21b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:42.855465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d53dab6-39dc-4839-9e93-8a41716c21b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:42.855946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d53dab6-39dc-4839-9e93-8a41716c21b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:42.856407 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d53dab6-39dc-4839-9e93-8a41716c21b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:42.857090 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d53dab6-39dc-4839-9e93-8a41716c21b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:42.857537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d53dab6-39dc-4839-9e93-8a41716c21b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:42.857959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d53dab6-39dc-4839-9e93-8a41716c21b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:43.129833 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2d53dab6-39dc-4839-9e93-8a41716c21b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:43.137543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2d53dab6-39dc-4839-9e93-8a41716c21b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1367 microversion: 2.1 time: 0.293460 Aug 10 17:02:43.138102 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 510/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:42 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:44.158529 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-692e0c34-4176-40fe-b071-e6a0252441f4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:44.159228 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-692e0c34-4176-40fe-b071-e6a0252441f4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:44.165992 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-692e0c34-4176-40fe-b071-e6a0252441f4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:44.166474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-692e0c34-4176-40fe-b071-e6a0252441f4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:44.166912 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-692e0c34-4176-40fe-b071-e6a0252441f4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:44.168104 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-692e0c34-4176-40fe-b071-e6a0252441f4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:44.168573 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-692e0c34-4176-40fe-b071-e6a0252441f4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:44.169000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-692e0c34-4176-40fe-b071-e6a0252441f4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:44.299821 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-692e0c34-4176-40fe-b071-e6a0252441f4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:44.307173 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-692e0c34-4176-40fe-b071-e6a0252441f4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1367 microversion: 2.1 time: 0.152877 Aug 10 17:02:44.307777 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 491/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:44 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:45.326821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-79d9ba01-6876-4cfe-ba8c-7fd97827ac02 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:45.327429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-79d9ba01-6876-4cfe-ba8c-7fd97827ac02 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:45.333905 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79d9ba01-6876-4cfe-ba8c-7fd97827ac02 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:45.334641 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79d9ba01-6876-4cfe-ba8c-7fd97827ac02 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:45.335081 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79d9ba01-6876-4cfe-ba8c-7fd97827ac02 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:45.335763 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79d9ba01-6876-4cfe-ba8c-7fd97827ac02 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:45.336244 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79d9ba01-6876-4cfe-ba8c-7fd97827ac02 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:45.336669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79d9ba01-6876-4cfe-ba8c-7fd97827ac02 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:45.470624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-79d9ba01-6876-4cfe-ba8c-7fd97827ac02 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:45.478360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-79d9ba01-6876-4cfe-ba8c-7fd97827ac02 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1367 microversion: 2.1 time: 0.155375 Aug 10 17:02:45.479119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 511/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:45 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:46.500374 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f2dbc8e-04f4-4a63-b1d3-627dfe6a10ef tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:46.500989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4f2dbc8e-04f4-4a63-b1d3-627dfe6a10ef tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:46.507778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2dbc8e-04f4-4a63-b1d3-627dfe6a10ef tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:46.508535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2dbc8e-04f4-4a63-b1d3-627dfe6a10ef tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:46.508985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2dbc8e-04f4-4a63-b1d3-627dfe6a10ef tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:46.509694 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2dbc8e-04f4-4a63-b1d3-627dfe6a10ef tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:46.510156 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2dbc8e-04f4-4a63-b1d3-627dfe6a10ef tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:46.510589 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2dbc8e-04f4-4a63-b1d3-627dfe6a10ef tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:46.646479 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4f2dbc8e-04f4-4a63-b1d3-627dfe6a10ef tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:46.648900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:46.656115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f2dbc8e-04f4-4a63-b1d3-627dfe6a10ef tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1367 microversion: 2.1 time: 0.159643 Aug 10 17:02:46.656744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 492/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:46 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:47.677599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e3301651-9bf5-47cf-ad34-c291d4c2a188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:47.678237 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e3301651-9bf5-47cf-ad34-c291d4c2a188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:47.685087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3301651-9bf5-47cf-ad34-c291d4c2a188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:47.685574 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3301651-9bf5-47cf-ad34-c291d4c2a188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:47.686009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3301651-9bf5-47cf-ad34-c291d4c2a188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:47.686713 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3301651-9bf5-47cf-ad34-c291d4c2a188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:47.687162 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3301651-9bf5-47cf-ad34-c291d4c2a188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:47.687582 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3301651-9bf5-47cf-ad34-c291d4c2a188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:47.833120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e3301651-9bf5-47cf-ad34-c291d4c2a188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:47.841603 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e3301651-9bf5-47cf-ad34-c291d4c2a188 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1367 microversion: 2.1 time: 0.167216 Aug 10 17:02:47.842158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 512/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:47 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:48.146327 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b88cfc8b-6465-4dd1-bbc6-5b51dbbf6ffa req-ecba63b5-0e15-41c5-9e1c-b57878be454e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7432bd1c-aa00-4a08-95e9-63b9da22967f", "name": "network-vif-plugged", "status": "completed", "tag": "42838665-21f4-4962-979d-dee2bed7cf1f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:48.157635 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b88cfc8b-6465-4dd1-bbc6-5b51dbbf6ffa req-ecba63b5-0e15-41c5-9e1c-b57878be454e service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:48.158816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b88cfc8b-6465-4dd1-bbc6-5b51dbbf6ffa req-ecba63b5-0e15-41c5-9e1c-b57878be454e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:48.159365 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b88cfc8b-6465-4dd1-bbc6-5b51dbbf6ffa req-ecba63b5-0e15-41c5-9e1c-b57878be454e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:48.170889 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b88cfc8b-6465-4dd1-bbc6-5b51dbbf6ffa req-ecba63b5-0e15-41c5-9e1c-b57878be454e service nova] Creating event network-vif-plugged:42838665-21f4-4962-979d-dee2bed7cf1f for instance 7432bd1c-aa00-4a08-95e9-63b9da22967f on hv-cinder-83602 Aug 10 17:02:48.175876 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b88cfc8b-6465-4dd1-bbc6-5b51dbbf6ffa req-ecba63b5-0e15-41c5-9e1c-b57878be454e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034506 Aug 10 17:02:48.176716 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 493/1005] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:48.525554 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-35c30fae-93ea-4c85-96a5-54e9275d181b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:48.526069 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-35c30fae-93ea-4c85-96a5-54e9275d181b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:48.532231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35c30fae-93ea-4c85-96a5-54e9275d181b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:48.532722 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35c30fae-93ea-4c85-96a5-54e9275d181b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:48.533187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35c30fae-93ea-4c85-96a5-54e9275d181b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:48.533875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35c30fae-93ea-4c85-96a5-54e9275d181b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:48.534330 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35c30fae-93ea-4c85-96a5-54e9275d181b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:48.534758 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35c30fae-93ea-4c85-96a5-54e9275d181b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:48.563312 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-35c30fae-93ea-4c85-96a5-54e9275d181b tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments/763be886-6c06-4592-aa01-59ed583f5edc" status: 200 len: 194 microversion: 2.20 time: 0.041774 Aug 10 17:02:48.563881 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 513/1006] 10.222.0.25 () {60 vars in 1454 bytes} [Wed Aug 10 17:02:48 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments/763be886-6c06-4592-aa01-59ed583f5edc => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:02:48.631562 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8796d381-3cfb-4975-94cc-00c63d79aabe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:48.632194 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8796d381-3cfb-4975-94cc-00c63d79aabe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:48.638237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8796d381-3cfb-4975-94cc-00c63d79aabe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:48.638722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8796d381-3cfb-4975-94cc-00c63d79aabe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:48.639159 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8796d381-3cfb-4975-94cc-00c63d79aabe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:48.639843 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8796d381-3cfb-4975-94cc-00c63d79aabe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:48.640342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8796d381-3cfb-4975-94cc-00c63d79aabe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:48.640769 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8796d381-3cfb-4975-94cc-00c63d79aabe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:48.719378 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-8796d381-3cfb-4975-94cc-00c63d79aabe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lazy-loading 'services' on Instance uuid 9c45104f-0ee5-4fec-92ad-7937cbe53805 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:02:48.790408 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8796d381-3cfb-4975-94cc-00c63d79aabe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments/763be886-6c06-4592-aa01-59ed583f5edc" status: 202 len: 0 microversion: 2.20 time: 0.163043 Aug 10 17:02:48.790990 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 494/1007] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Aug 10 17:02:48 2022] DELETE /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments/763be886-6c06-4592-aa01-59ed583f5edc => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:02:48.799955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-85ac9674-48d8-4ce7-9273-827e0c881f39 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:48.802200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-85ac9674-48d8-4ce7-9273-827e0c881f39 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:48.808480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85ac9674-48d8-4ce7-9273-827e0c881f39 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:48.808975 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85ac9674-48d8-4ce7-9273-827e0c881f39 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:48.809391 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85ac9674-48d8-4ce7-9273-827e0c881f39 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:48.810074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85ac9674-48d8-4ce7-9273-827e0c881f39 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:48.810523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85ac9674-48d8-4ce7-9273-827e0c881f39 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:48.810947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-85ac9674-48d8-4ce7-9273-827e0c881f39 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:48.839848 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-85ac9674-48d8-4ce7-9273-827e0c881f39 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043712 Aug 10 17:02:48.840426 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 514/1008] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Aug 10 17:02:48 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:02:48.862900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1f3b5c64-211c-4f89-b343-eea603a931b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:48.863626 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1f3b5c64-211c-4f89-b343-eea603a931b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:48.869793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c64-211c-4f89-b343-eea603a931b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:48.870271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c64-211c-4f89-b343-eea603a931b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:48.870709 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c64-211c-4f89-b343-eea603a931b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:48.871396 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c64-211c-4f89-b343-eea603a931b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:48.871846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c64-211c-4f89-b343-eea603a931b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:48.872303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c64-211c-4f89-b343-eea603a931b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:49.002474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1f3b5c64-211c-4f89-b343-eea603a931b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:49.010862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1f3b5c64-211c-4f89-b343-eea603a931b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1367 microversion: 2.1 time: 0.152062 Aug 10 17:02:49.011428 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 495/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:48 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:49.852206 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0412b198-3fc3-40aa-9e5b-ff17ebf1dd5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:49.854382 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0412b198-3fc3-40aa-9e5b-ff17ebf1dd5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:49.856259 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:49.861538 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0412b198-3fc3-40aa-9e5b-ff17ebf1dd5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:49.862024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0412b198-3fc3-40aa-9e5b-ff17ebf1dd5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:49.862456 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0412b198-3fc3-40aa-9e5b-ff17ebf1dd5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:49.863144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0412b198-3fc3-40aa-9e5b-ff17ebf1dd5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:49.863591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0412b198-3fc3-40aa-9e5b-ff17ebf1dd5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:49.864013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0412b198-3fc3-40aa-9e5b-ff17ebf1dd5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:49.892471 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0412b198-3fc3-40aa-9e5b-ff17ebf1dd5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044454 Aug 10 17:02:49.893011 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 515/1010] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Aug 10 17:02:49 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:02:50.032845 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e4f15a0c-da7b-437b-b65a-84714abf0933 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:50.033459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e4f15a0c-da7b-437b-b65a-84714abf0933 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:50.035841 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:50.036523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:50.042375 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4f15a0c-da7b-437b-b65a-84714abf0933 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:50.042869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4f15a0c-da7b-437b-b65a-84714abf0933 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:50.043307 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4f15a0c-da7b-437b-b65a-84714abf0933 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:50.044544 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4f15a0c-da7b-437b-b65a-84714abf0933 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:50.045004 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4f15a0c-da7b-437b-b65a-84714abf0933 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:50.045431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4f15a0c-da7b-437b-b65a-84714abf0933 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:50.171510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e4f15a0c-da7b-437b-b65a-84714abf0933 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:50.178816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e4f15a0c-da7b-437b-b65a-84714abf0933 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1367 microversion: 2.1 time: 0.150902 Aug 10 17:02:50.179376 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 496/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:50 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:50.904372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ef75a046-a509-4b75-a6a4-2d1d671bf967 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:50.906580 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ef75a046-a509-4b75-a6a4-2d1d671bf967 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:50.912947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef75a046-a509-4b75-a6a4-2d1d671bf967 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:50.913430 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef75a046-a509-4b75-a6a4-2d1d671bf967 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:50.913859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef75a046-a509-4b75-a6a4-2d1d671bf967 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:50.914548 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef75a046-a509-4b75-a6a4-2d1d671bf967 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:50.914998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef75a046-a509-4b75-a6a4-2d1d671bf967 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:50.915418 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef75a046-a509-4b75-a6a4-2d1d671bf967 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:50.945539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ef75a046-a509-4b75-a6a4-2d1d671bf967 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045195 Aug 10 17:02:50.946087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 516/1012] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Aug 10 17:02:50 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:02:51.200656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-27f1daf5-190c-4f72-8691-f7fcc9feac07 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:51.201263 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-27f1daf5-190c-4f72-8691-f7fcc9feac07 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:51.207244 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f1daf5-190c-4f72-8691-f7fcc9feac07 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:51.207728 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f1daf5-190c-4f72-8691-f7fcc9feac07 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:51.208167 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f1daf5-190c-4f72-8691-f7fcc9feac07 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:51.208862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f1daf5-190c-4f72-8691-f7fcc9feac07 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:51.209568 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f1daf5-190c-4f72-8691-f7fcc9feac07 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:51.209986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f1daf5-190c-4f72-8691-f7fcc9feac07 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:51.339595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-27f1daf5-190c-4f72-8691-f7fcc9feac07 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:51.347584 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-27f1daf5-190c-4f72-8691-f7fcc9feac07 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1557 microversion: 2.1 time: 0.150863 Aug 10 17:02:51.348166 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 497/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:02:51 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:51.367511 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-419fccae-c764-47d3-853b-e1e60dd8d2d1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:51.367997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-419fccae-c764-47d3-853b-e1e60dd8d2d1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:51.373819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-419fccae-c764-47d3-853b-e1e60dd8d2d1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:51.374300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-419fccae-c764-47d3-853b-e1e60dd8d2d1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:51.374745 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-419fccae-c764-47d3-853b-e1e60dd8d2d1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:51.375433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-419fccae-c764-47d3-853b-e1e60dd8d2d1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:51.375888 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-419fccae-c764-47d3-853b-e1e60dd8d2d1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:51.376352 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-419fccae-c764-47d3-853b-e1e60dd8d2d1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:51.452312 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-419fccae-c764-47d3-853b-e1e60dd8d2d1 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088655 Aug 10 17:02:51.452900 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 517/1014] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 10 17:02:51 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:51.958240 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c544ad30-82ee-4920-9fa0-4fdaa4824ad3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:51.960780 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c544ad30-82ee-4920-9fa0-4fdaa4824ad3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:51.967825 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c544ad30-82ee-4920-9fa0-4fdaa4824ad3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:51.968372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c544ad30-82ee-4920-9fa0-4fdaa4824ad3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:51.968852 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c544ad30-82ee-4920-9fa0-4fdaa4824ad3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:51.969586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c544ad30-82ee-4920-9fa0-4fdaa4824ad3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:51.970051 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c544ad30-82ee-4920-9fa0-4fdaa4824ad3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:51.970507 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c544ad30-82ee-4920-9fa0-4fdaa4824ad3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:52.000372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c544ad30-82ee-4920-9fa0-4fdaa4824ad3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045994 Aug 10 17:02:52.000941 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 498/1015] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Aug 10 17:02:51 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:02:52.393312 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-93f03848-a1f7-4fbc-9cb7-2c00af8952da req-039b6aa9-28d4-47d9-86fd-b9e292594261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7432bd1c-aa00-4a08-95e9-63b9da22967f", "tag": "42838665-21f4-4962-979d-dee2bed7cf1f"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:52.402319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-93f03848-a1f7-4fbc-9cb7-2c00af8952da req-039b6aa9-28d4-47d9-86fd-b9e292594261 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:52.402803 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-93f03848-a1f7-4fbc-9cb7-2c00af8952da req-039b6aa9-28d4-47d9-86fd-b9e292594261 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:52.403240 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-93f03848-a1f7-4fbc-9cb7-2c00af8952da req-039b6aa9-28d4-47d9-86fd-b9e292594261 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:52.415467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-93f03848-a1f7-4fbc-9cb7-2c00af8952da req-039b6aa9-28d4-47d9-86fd-b9e292594261 service nova] Creating event network-changed:42838665-21f4-4962-979d-dee2bed7cf1f for instance 7432bd1c-aa00-4a08-95e9-63b9da22967f on hv-cinder-83602 Aug 10 17:02:52.420742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-93f03848-a1f7-4fbc-9cb7-2c00af8952da req-039b6aa9-28d4-47d9-86fd-b9e292594261 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031451 Aug 10 17:02:52.421618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 518/1016] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:53.016853 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1a379968-2b3b-4f55-be88-c41fea651729 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:53.021890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1a379968-2b3b-4f55-be88-c41fea651729 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:53.033372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a379968-2b3b-4f55-be88-c41fea651729 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:53.035006 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a379968-2b3b-4f55-be88-c41fea651729 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:53.035797 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a379968-2b3b-4f55-be88-c41fea651729 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:53.036786 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a379968-2b3b-4f55-be88-c41fea651729 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:53.037533 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a379968-2b3b-4f55-be88-c41fea651729 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:53.038128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a379968-2b3b-4f55-be88-c41fea651729 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:53.070714 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1a379968-2b3b-4f55-be88-c41fea651729 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061243 Aug 10 17:02:53.071516 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 499/1017] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Aug 10 17:02:53 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:02:53.137397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ce947783-0224-418a-8789-8f197eb671dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:53.138593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ce947783-0224-418a-8789-8f197eb671dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:53.145649 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce947783-0224-418a-8789-8f197eb671dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:53.146421 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce947783-0224-418a-8789-8f197eb671dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:53.146940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce947783-0224-418a-8789-8f197eb671dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:53.147705 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce947783-0224-418a-8789-8f197eb671dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:53.148268 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce947783-0224-418a-8789-8f197eb671dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:53.148757 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce947783-0224-418a-8789-8f197eb671dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:53.176960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ce947783-0224-418a-8789-8f197eb671dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:02:53.262277 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ce947783-0224-418a-8789-8f197eb671dd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 204 len: 0 microversion: 2.20 time: 0.128776 Aug 10 17:02:53.267877 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 519/1018] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Aug 10 17:02:53 2022] DELETE /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:02:53.273510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:53.274125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:53.281811 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:53.282311 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:53.282757 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:53.283449 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:53.283908 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:53.284365 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:53.423034 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:53.431306 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:53.432926 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:53.434175 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cd4b36f9-9620-4807-b4bd-ec742ab32b2f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.165187 Aug 10 17:02:53.435314 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 500/1019] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:02:53 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:02:54.458058 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:54.458747 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:54.465380 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:54.466533 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:54.466958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:54.467647 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:54.468089 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:54.468532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:54.596038 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:54.603909 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:54.605419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:54.606596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-137a5535-08e0-47d7-96b1-a52197125dc2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.152817 Aug 10 17:02:54.607129 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 520/1020] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:02:54 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:02:55.629807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:55.630349 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:55.636921 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:55.637410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:55.637862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:55.639215 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:55.639673 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:55.640275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:55.765859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:55.773775 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:55.775287 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:55.776470 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9ae19207-6b07-4fdb-98ba-7d7d1baf69ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1723 microversion: 2.20 time: 0.150713 Aug 10 17:02:55.777034 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 501/1021] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:02:55 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:02:56.646818 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-3ab3503d-c23d-419e-af9c-ecf84bb158c1 req-48c1a637-d97e-405b-8867-f779dd65a1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c45104f-0ee5-4fec-92ad-7937cbe53805", "name": "network-vif-deleted", "tag": "da10f762-bc62-4992-aee6-1b182938963c"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:56.659236 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3ab3503d-c23d-419e-af9c-ecf84bb158c1 req-48c1a637-d97e-405b-8867-f779dd65a1c0 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:56.659722 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3ab3503d-c23d-419e-af9c-ecf84bb158c1 req-48c1a637-d97e-405b-8867-f779dd65a1c0 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:56.660233 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3ab3503d-c23d-419e-af9c-ecf84bb158c1 req-48c1a637-d97e-405b-8867-f779dd65a1c0 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:56.671437 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-3ab3503d-c23d-419e-af9c-ecf84bb158c1 req-48c1a637-d97e-405b-8867-f779dd65a1c0 service nova] Creating event network-vif-deleted:da10f762-bc62-4992-aee6-1b182938963c for instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 on hv-cinder-83602 Aug 10 17:02:56.676359 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-3ab3503d-c23d-419e-af9c-ecf84bb158c1 req-48c1a637-d97e-405b-8867-f779dd65a1c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033150 Aug 10 17:02:56.676960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 521/1022] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:02:56.799229 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:56.800772 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:56.808620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:56.809387 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:56.809976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:56.811047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:56.820000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:56.820991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:56.866603 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:56.867212 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:56.867642 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:56.868091 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lazy-loading 'fault' on Instance uuid 9c45104f-0ee5-4fec-92ad-7937cbe53805 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:02:56.909753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:56.918565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:56.920129 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:02:56.921297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-852add5d-b406-46ef-b88c-4396796220e3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 200 len: 1371 microversion: 2.20 time: 0.126184 Aug 10 17:02:56.921893 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 502/1023] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:02:56 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:02:57.945900 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:57.946587 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:02:57.953492 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:57.953974 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:57.954404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:57.955092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:02:57.955538 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:02:57.955961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:02:57.969022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] HTTP exception thrown: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Request method failure captured: Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 HTTP/1.1 Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LkD9sTQbcKD13QCfmhebXwBJAiYPGeKWZ-x4UbcerapURqGS8WB8WNddlGrolN6QUV36dmgyGf-Bw3acSdWm48QYs9v1zllrX6Oz6qxzOHwsiQQzaP6buqE6RlJ5V1JbNv5oxxpnj_zTMamZ5goljR_z88bEdeKqaa7KXlnby10-4 Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:02:57.970617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17c2f74324146ca932ff151c9f7a003", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 96495ad2ad764ba3a0fb1e3bc28fd8bd Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:02:57.972392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '9c45104f-0ee5-4fec-92ad-7937cbe53805'} Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:02:57.973211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:02:57.974670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:02:57.976002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Returning 404 to user: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:02:57.976002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8d9a9e2e-88d7-498a-a2da-0a1b23a91084 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 404 len: 111 microversion: 2.20 time: 0.030969 Aug 10 17:02:57.976002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 522/1024] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:02:57 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:02:57.981340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61580b0a-f52b-41ae-8e68-a4fb7d2a71ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '.version_select at 0x7f5b083279d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:02:58.000723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-61580b0a-f52b-41ae-8e68-a4fb7d2a71ad tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825176426" status: 204 len: 0 microversion: 2.20 time: 0.023348 Aug 10 17:02:58.001383 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 503/1025] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Aug 10 17:02:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825176426 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:02:58.828100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3395ae3b-e961-42fe-8d45-83f1031a1920 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Action: 'create', calling method: .version_select at 0x7f5b0c995e50>, body: {"keypair": {"name": "tempest-keypair-335601592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDPwOBhkDFoWjQvHi3Le9xX2UtmOQhA510q3bkG/IOfak28Q1WsxbgYvvR/IGPKgyxUBRWwUQKQnXmtWbaqhfifNYVOJxjtY5cXJJB8STzD5rNsrVjpzm5WWoVNdrxfkw=="}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:02:58.843882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-3395ae3b-e961-42fe-8d45-83f1031a1920 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Getting quotas for project d17c2f74324146ca932ff151c9f7a003. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:02:58.847656 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-3395ae3b-e961-42fe-8d45-83f1031a1920 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Getting quotas for user 96495ad2ad764ba3a0fb1e3bc28fd8bd and project d17c2f74324146ca932ff151c9f7a003. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:02:58.868698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3395ae3b-e961-42fe-8d45-83f1031a1920 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045057 Aug 10 17:02:58.869277 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 523/1026] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Aug 10 17:02:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 10 17:03:00.051475 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-624876367", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a34b9ffa-6cd7-4dc0-afee-b8aa4e4d33d1"}], "security_groups": [{"name": "tempest-securitygroup--2092768609"}], "key_name": "tempest-keypair-335601592", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:00.150645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] validate_networks() for [('a34b9ffa-6cd7-4dc0-afee-b8aa4e4d33d1', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:03:00.505992 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:03:00.506455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:03:00.506932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:03:00.507346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:03:00.507879 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:03:00.517076 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:00.517588 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:00.518033 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:00.518764 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:00.519221 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:00.519651 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:00.536728 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Getting quotas for project d17c2f74324146ca932ff151c9f7a003. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:03:00.541529 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Getting quotas for user 96495ad2ad764ba3a0fb1e3bc28fd8bd and project d17c2f74324146ca932ff151c9f7a003. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:03:00.552911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:03:00.555169 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:03:00.601746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e94b133b-4d85-4b14-a183-e1014c25e35d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.555237 Aug 10 17:03:00.602397 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 504/1027] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Aug 10 17:03:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 17:03:00.613623 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4d44f8e7-9d20-4ec2-9b2c-177f94f5caa9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:00.614275 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4d44f8e7-9d20-4ec2-9b2c-177f94f5caa9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:00.671111 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4d44f8e7-9d20-4ec2-9b2c-177f94f5caa9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:00.678422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4d44f8e7-9d20-4ec2-9b2c-177f94f5caa9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:00.679922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4d44f8e7-9d20-4ec2-9b2c-177f94f5caa9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:00.681075 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4d44f8e7-9d20-4ec2-9b2c-177f94f5caa9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1280 microversion: 2.20 time: 0.071805 Aug 10 17:03:00.681628 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 524/1028] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:03:00 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:03:01.703468 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:01.703996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:01.710893 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:01.711371 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:01.711802 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:01.712656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:01.714128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:01.714128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:01.775395 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:01.784308 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:01.785825 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:01.786929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c86dd12d-5644-4045-a74f-b0c708e1b08d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1332 microversion: 2.20 time: 0.087971 Aug 10 17:03:01.787487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 505/1029] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:03:01 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:03:02.808604 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:02.809198 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:02.815595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:02.816076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:02.816561 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:02.817250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:02.817693 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:02.818111 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:02.822122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:03.067731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:03.077813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:03.079381 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:03.080814 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a6b24e04-e92a-4f55-b356-bac6a5218a00 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1406 microversion: 2.20 time: 0.276142 Aug 10 17:03:03.081809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 525/1030] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:03:02 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:03:03.484445 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-197e6a02-cab3-41e7-89c1-fb498f722594 req-ac600f99-354a-426d-970b-ed8ed37b4c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55af62cb-d5be-4fef-b179-39240d0b13cb", "tag": "228e4301-98ff-4548-915d-d44107e8a96d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:03.497216 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-197e6a02-cab3-41e7-89c1-fb498f722594 req-ac600f99-354a-426d-970b-ed8ed37b4c76 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:03.498376 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-197e6a02-cab3-41e7-89c1-fb498f722594 req-ac600f99-354a-426d-970b-ed8ed37b4c76 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:03.498799 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-197e6a02-cab3-41e7-89c1-fb498f722594 req-ac600f99-354a-426d-970b-ed8ed37b4c76 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:03.510072 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-197e6a02-cab3-41e7-89c1-fb498f722594 req-ac600f99-354a-426d-970b-ed8ed37b4c76 service nova] Creating event network-changed:228e4301-98ff-4548-915d-d44107e8a96d for instance 55af62cb-d5be-4fef-b179-39240d0b13cb on hv-cinder-83602 Aug 10 17:03:03.514929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-197e6a02-cab3-41e7-89c1-fb498f722594 req-ac600f99-354a-426d-970b-ed8ed37b4c76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034787 Aug 10 17:03:03.515513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 506/1031] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:03:04.102790 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:04.103401 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:04.109853 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:04.110334 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:04.110767 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:04.111451 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:04.111897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:04.112352 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:04.238567 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:04.246357 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:04.247845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:04.248976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4eabe545-5968-4122-aac1-8d62f5c743de tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1406 microversion: 2.20 time: 0.150092 Aug 10 17:03:04.249527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 526/1032] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:03:04 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:03:05.274844 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:05.275582 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:05.281744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:05.282791 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:05.283233 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:05.283933 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:05.284421 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:05.284851 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:05.414607 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:05.423207 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:05.424769 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:05.425931 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8fb588b3-9c25-48d9-9985-8964598f8485 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1406 microversion: 2.20 time: 0.157474 Aug 10 17:03:05.426448 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 507/1033] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:03:05 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:03:06.447954 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:06.448657 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:06.455074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:06.455556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:06.455990 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:06.456713 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:06.457159 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:06.457579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:06.586429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:06.594757 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:06.596287 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:06.597381 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1bb71290-2096-49ac-b646-c7d00229772e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1406 microversion: 2.20 time: 0.153368 Aug 10 17:03:06.597936 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 527/1034] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:03:06 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:03:07.630861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:07.632068 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:07.639366 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:07.639973 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:07.640623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:07.641455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:07.641913 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:07.644863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:07.776572 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:07.784510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:07.786012 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:07.787150 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c9391d1e-a454-465a-b63c-cbd2125a81b8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1406 microversion: 2.20 time: 0.160805 Aug 10 17:03:07.787716 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 508/1035] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:03:07 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:03:08.809660 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:08.810294 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:08.817275 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:08.817760 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:08.818190 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:08.818878 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:08.819327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:08.819744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:08.951124 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:08.959744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:08.961259 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:08.962347 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f7821764-5c88-4630-831b-0aaf7f6eef08 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1406 microversion: 2.20 time: 0.156636 Aug 10 17:03:08.962889 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 528/1036] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:03:08 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:03:09.983954 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:09.984579 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:09.991723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:09.992286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:09.992725 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:09.993501 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:09.994019 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:09.994474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:10.124329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:10.133073 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:10.134576 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:10.135678 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bf33a1d1-a4fb-4e63-8790-016ac8014dcd tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1406 microversion: 2.20 time: 0.155696 Aug 10 17:03:10.136288 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 509/1037] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:03:09 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:03:10.215971 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-d9c2bd2e-2ecd-4461-9e2a-874540fe0785 req-ef4d6ed5-cb8c-4699-9485-f746e1b28112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55af62cb-d5be-4fef-b179-39240d0b13cb", "name": "network-vif-plugged", "status": "completed", "tag": "228e4301-98ff-4548-915d-d44107e8a96d"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:10.225780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d9c2bd2e-2ecd-4461-9e2a-874540fe0785 req-ef4d6ed5-cb8c-4699-9485-f746e1b28112 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:10.226283 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d9c2bd2e-2ecd-4461-9e2a-874540fe0785 req-ef4d6ed5-cb8c-4699-9485-f746e1b28112 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:10.226709 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d9c2bd2e-2ecd-4461-9e2a-874540fe0785 req-ef4d6ed5-cb8c-4699-9485-f746e1b28112 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:10.238249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-d9c2bd2e-2ecd-4461-9e2a-874540fe0785 req-ef4d6ed5-cb8c-4699-9485-f746e1b28112 service nova] Creating event network-vif-plugged:228e4301-98ff-4548-915d-d44107e8a96d for instance 55af62cb-d5be-4fef-b179-39240d0b13cb on hv-cinder-83602 Aug 10 17:03:10.243262 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-d9c2bd2e-2ecd-4461-9e2a-874540fe0785 req-ef4d6ed5-cb8c-4699-9485-f746e1b28112 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031022 Aug 10 17:03:10.243843 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 529/1038] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:03:11.158440 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:11.158991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:11.160886 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:11.161612 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:11.168249 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:11.168735 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:11.169172 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:11.169861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:11.170316 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:11.170741 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:11.301005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:11.308717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:11.310225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:11.311327 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-78adfe80-5b2f-460e-a210-408a1711fdaf tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1406 microversion: 2.20 time: 0.156905 Aug 10 17:03:11.311882 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 510/1039] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:03:11 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:03:12.331486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:12.336715 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:12.337411 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:12.339143 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:12.344983 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:12.345505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:12.345947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:12.347260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:12.347716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:12.348163 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:12.478676 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:12.486498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:12.488013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:12.489205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-618bdfdc-7830-4483-bbbf-ee4b35d26319 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1598 microversion: 2.20 time: 0.159165 Aug 10 17:03:12.489774 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 530/1040] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:03:12 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:03:12.511095 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-284f15b7-db66-46f6-adda-8703f43a2a20 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:12.511671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-284f15b7-db66-46f6-adda-8703f43a2a20 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:12.513873 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:12.519607 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-284f15b7-db66-46f6-adda-8703f43a2a20 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:12.520094 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-284f15b7-db66-46f6-adda-8703f43a2a20 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:12.520562 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-284f15b7-db66-46f6-adda-8703f43a2a20 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:12.521260 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-284f15b7-db66-46f6-adda-8703f43a2a20 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:12.521717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-284f15b7-db66-46f6-adda-8703f43a2a20 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:12.522147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-284f15b7-db66-46f6-adda-8703f43a2a20 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:12.535964 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:12.600006 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-284f15b7-db66-46f6-adda-8703f43a2a20 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092707 Aug 10 17:03:12.600637 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 511/1041] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Aug 10 17:03:12 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:03:13.739385 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-ea9eb8e8-7882-4551-807c-2360a834f15d req-254e2fa5-c3de-457b-bb6c-d23f38ed8db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55af62cb-d5be-4fef-b179-39240d0b13cb", "tag": "228e4301-98ff-4548-915d-d44107e8a96d"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:13.749733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ea9eb8e8-7882-4551-807c-2360a834f15d req-254e2fa5-c3de-457b-bb6c-d23f38ed8db4 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:13.750214 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ea9eb8e8-7882-4551-807c-2360a834f15d req-254e2fa5-c3de-457b-bb6c-d23f38ed8db4 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:13.750645 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ea9eb8e8-7882-4551-807c-2360a834f15d req-254e2fa5-c3de-457b-bb6c-d23f38ed8db4 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:13.761461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-ea9eb8e8-7882-4551-807c-2360a834f15d req-254e2fa5-c3de-457b-bb6c-d23f38ed8db4 service nova] Creating event network-changed:228e4301-98ff-4548-915d-d44107e8a96d for instance 55af62cb-d5be-4fef-b179-39240d0b13cb on hv-cinder-83602 Aug 10 17:03:13.766605 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-ea9eb8e8-7882-4551-807c-2360a834f15d req-254e2fa5-c3de-457b-bb6c-d23f38ed8db4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031096 Aug 10 17:03:13.767210 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 531/1042] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:03:19.389549 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:03:19.390248 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Wed Aug 10 17:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:03:21.857919 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-03060442-4379-45b3-9fdc-521f2710da8a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:21.858447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-03060442-4379-45b3-9fdc-521f2710da8a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:21.864965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03060442-4379-45b3-9fdc-521f2710da8a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:21.865462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03060442-4379-45b3-9fdc-521f2710da8a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:21.865904 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03060442-4379-45b3-9fdc-521f2710da8a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:21.866605 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03060442-4379-45b3-9fdc-521f2710da8a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:21.867063 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03060442-4379-45b3-9fdc-521f2710da8a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:21.867489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03060442-4379-45b3-9fdc-521f2710da8a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:21.947870 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-03060442-4379-45b3-9fdc-521f2710da8a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lazy-loading 'services' on Instance uuid c5e3c08d-8649-4c99-8c7c-a57166ebc96b {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:03:22.017485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-03060442-4379-45b3-9fdc-521f2710da8a tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments/93282e50-d378-403c-adf8-0022ea8567cc" status: 202 len: 0 microversion: 2.1 time: 0.164046 Aug 10 17:03:22.018136 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 512/1043] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 17:03:21 2022] DELETE /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments/93282e50-d378-403c-adf8-0022ea8567cc => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:03:22.028348 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d17e5798-4c73-49f2-aeb7-9a8e859e55da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:22.030671 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d17e5798-4c73-49f2-aeb7-9a8e859e55da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:22.039559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d17e5798-4c73-49f2-aeb7-9a8e859e55da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:22.040067 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d17e5798-4c73-49f2-aeb7-9a8e859e55da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:22.040538 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d17e5798-4c73-49f2-aeb7-9a8e859e55da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:22.041247 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d17e5798-4c73-49f2-aeb7-9a8e859e55da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:22.041707 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d17e5798-4c73-49f2-aeb7-9a8e859e55da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:22.042136 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d17e5798-4c73-49f2-aeb7-9a8e859e55da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:22.073781 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d17e5798-4c73-49f2-aeb7-9a8e859e55da tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049765 Aug 10 17:03:22.074257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 532/1044] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:03:22 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:03:23.088422 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7bcf6cf-4416-4484-a03d-67dd17280346 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:23.090645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a7bcf6cf-4416-4484-a03d-67dd17280346 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:23.097338 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7bcf6cf-4416-4484-a03d-67dd17280346 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:23.097827 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7bcf6cf-4416-4484-a03d-67dd17280346 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:23.098271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7bcf6cf-4416-4484-a03d-67dd17280346 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:23.098957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7bcf6cf-4416-4484-a03d-67dd17280346 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:23.099411 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7bcf6cf-4416-4484-a03d-67dd17280346 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:23.099835 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7bcf6cf-4416-4484-a03d-67dd17280346 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:23.129839 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7bcf6cf-4416-4484-a03d-67dd17280346 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046444 Aug 10 17:03:23.130454 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 513/1045] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:03:23 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:03:24.141343 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-83083a81-985c-48e5-8d4a-8ab872d90c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:24.143875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-83083a81-985c-48e5-8d4a-8ab872d90c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:24.150225 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83083a81-985c-48e5-8d4a-8ab872d90c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:24.150726 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83083a81-985c-48e5-8d4a-8ab872d90c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:24.151155 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83083a81-985c-48e5-8d4a-8ab872d90c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:24.151840 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83083a81-985c-48e5-8d4a-8ab872d90c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:24.152313 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83083a81-985c-48e5-8d4a-8ab872d90c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:24.152733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83083a81-985c-48e5-8d4a-8ab872d90c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:24.183214 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-83083a81-985c-48e5-8d4a-8ab872d90c5b tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045968 Aug 10 17:03:24.183759 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 533/1046] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:03:24 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:03:24.259513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e441adb7-74f9-4982-9ca2-f1670d285a92 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:24.260046 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e441adb7-74f9-4982-9ca2-f1670d285a92 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:24.266351 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e441adb7-74f9-4982-9ca2-f1670d285a92 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:24.266838 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e441adb7-74f9-4982-9ca2-f1670d285a92 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:24.267277 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e441adb7-74f9-4982-9ca2-f1670d285a92 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:24.267978 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e441adb7-74f9-4982-9ca2-f1670d285a92 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:24.268970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e441adb7-74f9-4982-9ca2-f1670d285a92 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:24.269400 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e441adb7-74f9-4982-9ca2-f1670d285a92 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:24.294138 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e441adb7-74f9-4982-9ca2-f1670d285a92 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:03:24.367896 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e441adb7-74f9-4982-9ca2-f1670d285a92 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 204 len: 0 microversion: 2.1 time: 0.111931 Aug 10 17:03:24.368515 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 514/1047] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:03:24 2022] DELETE /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:03:24.377341 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f28b06ab-8ab3-4862-95d8-52f9e67383a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:24.378730 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f28b06ab-8ab3-4862-95d8-52f9e67383a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:24.385955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f28b06ab-8ab3-4862-95d8-52f9e67383a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:24.386531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f28b06ab-8ab3-4862-95d8-52f9e67383a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:24.387100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f28b06ab-8ab3-4862-95d8-52f9e67383a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:24.387886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f28b06ab-8ab3-4862-95d8-52f9e67383a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:24.388549 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f28b06ab-8ab3-4862-95d8-52f9e67383a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:24.389096 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f28b06ab-8ab3-4862-95d8-52f9e67383a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:24.518979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f28b06ab-8ab3-4862-95d8-52f9e67383a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:24.526553 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f28b06ab-8ab3-4862-95d8-52f9e67383a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1689 microversion: 2.1 time: 0.153743 Aug 10 17:03:24.527113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 534/1048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:24 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:25.547772 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41746cea-f531-49a4-ae8e-98476d5be0a2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:25.548443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-41746cea-f531-49a4-ae8e-98476d5be0a2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:25.554801 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41746cea-f531-49a4-ae8e-98476d5be0a2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:25.555283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41746cea-f531-49a4-ae8e-98476d5be0a2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:25.555719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41746cea-f531-49a4-ae8e-98476d5be0a2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:25.556440 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41746cea-f531-49a4-ae8e-98476d5be0a2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:25.556902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41746cea-f531-49a4-ae8e-98476d5be0a2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:25.557327 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41746cea-f531-49a4-ae8e-98476d5be0a2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:25.685744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-41746cea-f531-49a4-ae8e-98476d5be0a2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:25.693867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-41746cea-f531-49a4-ae8e-98476d5be0a2 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1689 microversion: 2.1 time: 0.150425 Aug 10 17:03:25.694463 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 515/1049] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:25 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:26.715299 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ef4ec0c0-ff84-4457-8b8b-05e8aecf595c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:26.715902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ef4ec0c0-ff84-4457-8b8b-05e8aecf595c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:26.723050 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef4ec0c0-ff84-4457-8b8b-05e8aecf595c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:26.723536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef4ec0c0-ff84-4457-8b8b-05e8aecf595c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:26.723965 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef4ec0c0-ff84-4457-8b8b-05e8aecf595c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:26.724728 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef4ec0c0-ff84-4457-8b8b-05e8aecf595c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:26.725177 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef4ec0c0-ff84-4457-8b8b-05e8aecf595c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:26.725599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef4ec0c0-ff84-4457-8b8b-05e8aecf595c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:26.852858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ef4ec0c0-ff84-4457-8b8b-05e8aecf595c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:26.860244 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ef4ec0c0-ff84-4457-8b8b-05e8aecf595c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1689 microversion: 2.1 time: 0.148890 Aug 10 17:03:26.860801 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 535/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:26 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:27.883558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba521dd8-d676-4218-9176-35c4bed33391 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:27.884205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba521dd8-d676-4218-9176-35c4bed33391 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:27.890667 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba521dd8-d676-4218-9176-35c4bed33391 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:27.891152 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba521dd8-d676-4218-9176-35c4bed33391 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:27.891583 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba521dd8-d676-4218-9176-35c4bed33391 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:27.892299 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba521dd8-d676-4218-9176-35c4bed33391 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:27.892744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba521dd8-d676-4218-9176-35c4bed33391 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:27.893167 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba521dd8-d676-4218-9176-35c4bed33391 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:28.022605 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba521dd8-d676-4218-9176-35c4bed33391 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:28.030005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba521dd8-d676-4218-9176-35c4bed33391 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1689 microversion: 2.1 time: 0.151204 Aug 10 17:03:28.030578 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 516/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:27 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:29.052631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b2af40f-95de-4e7e-afb7-8cac4b2c5be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:29.053260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9b2af40f-95de-4e7e-afb7-8cac4b2c5be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:29.060550 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b2af40f-95de-4e7e-afb7-8cac4b2c5be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:29.061030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b2af40f-95de-4e7e-afb7-8cac4b2c5be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:29.061460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b2af40f-95de-4e7e-afb7-8cac4b2c5be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:29.062170 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b2af40f-95de-4e7e-afb7-8cac4b2c5be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:29.062616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b2af40f-95de-4e7e-afb7-8cac4b2c5be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:29.063093 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b2af40f-95de-4e7e-afb7-8cac4b2c5be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:29.150780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9b2af40f-95de-4e7e-afb7-8cac4b2c5be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:29.158295 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9b2af40f-95de-4e7e-afb7-8cac4b2c5be3 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1621 microversion: 2.1 time: 0.110326 Aug 10 17:03:29.158865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 536/1052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:29 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1621 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:29.325330 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-32a3901a-1de2-4870-b6aa-bef9615ab218 req-93e7eac2-fd29-4359-8064-669a00c39770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e3c08d-8649-4c99-8c7c-a57166ebc96b", "name": "network-vif-deleted", "tag": "6d51b077-087c-428f-af01-0240852d1af2"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:29.337132 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-32a3901a-1de2-4870-b6aa-bef9615ab218 req-93e7eac2-fd29-4359-8064-669a00c39770 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:29.337616 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-32a3901a-1de2-4870-b6aa-bef9615ab218 req-93e7eac2-fd29-4359-8064-669a00c39770 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:29.338046 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-32a3901a-1de2-4870-b6aa-bef9615ab218 req-93e7eac2-fd29-4359-8064-669a00c39770 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:29.357424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-32a3901a-1de2-4870-b6aa-bef9615ab218 req-93e7eac2-fd29-4359-8064-669a00c39770 service nova] Creating event network-vif-deleted:6d51b077-087c-428f-af01-0240852d1af2 for instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b on hv-cinder-83602 Aug 10 17:03:29.362471 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-32a3901a-1de2-4870-b6aa-bef9615ab218 req-93e7eac2-fd29-4359-8064-669a00c39770 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040923 Aug 10 17:03:29.363929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 517/1053] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:03:29.714304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-34f5ca6b-7822-4681-adeb-83ebcbbf5c59 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:29.714935 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-34f5ca6b-7822-4681-adeb-83ebcbbf5c59 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:29.720776 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34f5ca6b-7822-4681-adeb-83ebcbbf5c59 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:29.721258 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34f5ca6b-7822-4681-adeb-83ebcbbf5c59 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:29.721694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34f5ca6b-7822-4681-adeb-83ebcbbf5c59 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:29.722443 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34f5ca6b-7822-4681-adeb-83ebcbbf5c59 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:29.722894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34f5ca6b-7822-4681-adeb-83ebcbbf5c59 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:29.723319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34f5ca6b-7822-4681-adeb-83ebcbbf5c59 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:29.747175 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-34f5ca6b-7822-4681-adeb-83ebcbbf5c59 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:03:29.827868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-34f5ca6b-7822-4681-adeb-83ebcbbf5c59 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 204 len: 0 microversion: 2.1 time: 0.116973 Aug 10 17:03:29.828639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 537/1054] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:03:29 2022] DELETE /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:03:29.839386 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f2c9fb80-4903-4866-bb04-1a7fbaa850ba tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:29.842474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f2c9fb80-4903-4866-bb04-1a7fbaa850ba tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:29.850397 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb80-4903-4866-bb04-1a7fbaa850ba tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:29.851911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb80-4903-4866-bb04-1a7fbaa850ba tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:29.852520 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb80-4903-4866-bb04-1a7fbaa850ba tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:29.853349 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb80-4903-4866-bb04-1a7fbaa850ba tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:29.853954 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb80-4903-4866-bb04-1a7fbaa850ba tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:29.854502 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb80-4903-4866-bb04-1a7fbaa850ba tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:29.991893 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f2c9fb80-4903-4866-bb04-1a7fbaa850ba tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:29.999794 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f2c9fb80-4903-4866-bb04-1a7fbaa850ba tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1577 microversion: 2.1 time: 0.165660 Aug 10 17:03:30.000476 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 518/1055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:29 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:03:30.179458 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:30.180173 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:30.186704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:30.187196 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:30.187635 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:30.188381 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:30.188842 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:30.189301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:30.220732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:30.221218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:30.221657 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:30.222101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lazy-loading 'fault' on Instance uuid c5e3c08d-8649-4c99-8c7c-a57166ebc96b {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:03:30.266197 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:30.274345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-285c88d3-ed87-4204-ac03-11517eab4e28 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 200 len: 1335 microversion: 2.1 time: 0.099189 Aug 10 17:03:30.274909 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 538/1056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:30 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 1335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:31.020982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1bd86a37-5ebd-4ecc-bfb0-02d8077d60ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:31.021597 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1bd86a37-5ebd-4ecc-bfb0-02d8077d60ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:31.027881 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd86a37-5ebd-4ecc-bfb0-02d8077d60ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:31.028397 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd86a37-5ebd-4ecc-bfb0-02d8077d60ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:31.028834 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd86a37-5ebd-4ecc-bfb0-02d8077d60ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:31.029521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd86a37-5ebd-4ecc-bfb0-02d8077d60ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:31.029973 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd86a37-5ebd-4ecc-bfb0-02d8077d60ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:31.030398 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd86a37-5ebd-4ecc-bfb0-02d8077d60ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:31.165898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1bd86a37-5ebd-4ecc-bfb0-02d8077d60ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:31.173452 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1bd86a37-5ebd-4ecc-bfb0-02d8077d60ad tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1577 microversion: 2.1 time: 0.156446 Aug 10 17:03:31.174108 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 519/1057] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:31 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:31.297520 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:31.298075 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: c5e3c08d-8649-4c99-8c7c-a57166ebc96b] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:31.305184 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:31.305665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:31.306095 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:31.306779 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:31.307230 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:31.307652 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:31.320600 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] HTTP exception thrown: Instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b could not be found. Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Request method failure captured: Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b HTTP/1.1 Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lh1I9b-kzb_slWPvAVutdni9VM3659dFbvGG7qTcP042PDQs7hDKYwoJmH321qx5VWPk96Wr1z1hO4peTcy8akv6z-FleuR3FxKhnCOsmN7o9e6S20CSWhLrQ8J54JBEp1JiIbuk9o27XYyUSIPF3W2AYMFe1yND8oP5BURIf_OIQ Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 36cf7bbfa5d3420996a2af036cf8e0da Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:03:31.322300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36cf7bbfa5d3420996a2af036cf8e0da", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 36cf7bbfa5d3420996a2af036cf8e0da Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-ServerRescueNegativeTestJSON-1943156217-project Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: c7fac765624c4e0b85b01f356a14a1cb Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1943156217-project Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b could not be found. Aug 10 17:03:31.323902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'c5e3c08d-8649-4c99-8c7c-a57166ebc96b'} Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b could not be found. Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:03:31.324987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b could not be found. Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b could not be found. Aug 10 17:03:31.326300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:31.327527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Returning 404 to user: Instance c5e3c08d-8649-4c99-8c7c-a57166ebc96b could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:03:31.327527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-78122862-197c-4ab0-a300-3c66ccc8604c tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b" status: 404 len: 111 microversion: 2.1 time: 0.030154 Aug 10 17:03:31.327527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 539/1058] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:31 2022] GET /compute/v2.1/servers/c5e3c08d-8649-4c99-8c7c-a57166ebc96b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:03:31.332761 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f5776c4f-5b1e-47c5-9f70-fee1275bf7b6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '.version_select at 0x7f5b08346550>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:31.351208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f5776c4f-5b1e-47c5-9f70-fee1275bf7b6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-511194023" status: 202 len: 0 microversion: 2.1 time: 0.022217 Aug 10 17:03:31.351751 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 520/1059] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Aug 10 17:03:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-511194023 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:03:32.195274 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-01317734-a413-4d85-8c8b-f4a344bc2d86 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:32.196022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-01317734-a413-4d85-8c8b-f4a344bc2d86 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:32.201960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01317734-a413-4d85-8c8b-f4a344bc2d86 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:32.202432 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01317734-a413-4d85-8c8b-f4a344bc2d86 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:32.202857 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01317734-a413-4d85-8c8b-f4a344bc2d86 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:32.203541 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01317734-a413-4d85-8c8b-f4a344bc2d86 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:32.203988 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01317734-a413-4d85-8c8b-f4a344bc2d86 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:32.204431 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-01317734-a413-4d85-8c8b-f4a344bc2d86 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:32.542721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-01317734-a413-4d85-8c8b-f4a344bc2d86 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:32.550772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-01317734-a413-4d85-8c8b-f4a344bc2d86 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1577 microversion: 2.1 time: 0.359236 Aug 10 17:03:32.561798 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 540/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:32 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1577 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:32.996125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ad129b38-898b-4e36-8311-829d0e0bb24a req-c17bb79c-38c7-4d67-b26c-71943d3b07ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6995ac7-abff-47f3-a48c-a24fc437717e", "name": "network-vif-deleted", "tag": "e581d1b5-c12c-49b1-91c7-4fddf08829ab"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:33.006907 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ad129b38-898b-4e36-8311-829d0e0bb24a req-c17bb79c-38c7-4d67-b26c-71943d3b07ba service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:33.007519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ad129b38-898b-4e36-8311-829d0e0bb24a req-c17bb79c-38c7-4d67-b26c-71943d3b07ba service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:33.008188 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ad129b38-898b-4e36-8311-829d0e0bb24a req-c17bb79c-38c7-4d67-b26c-71943d3b07ba service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:33.019857 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ad129b38-898b-4e36-8311-829d0e0bb24a req-c17bb79c-38c7-4d67-b26c-71943d3b07ba service nova] Creating event network-vif-deleted:e581d1b5-c12c-49b1-91c7-4fddf08829ab for instance f6995ac7-abff-47f3-a48c-a24fc437717e on hv-cinder-83602 Aug 10 17:03:33.026507 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ad129b38-898b-4e36-8311-829d0e0bb24a req-c17bb79c-38c7-4d67-b26c-71943d3b07ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035078 Aug 10 17:03:33.027811 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 521/1061] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:03:33.573060 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:33.573839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:33.580891 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:33.581422 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:33.582461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:33.583158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:33.583601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:33.584016 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:33.587316 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:33.621013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:33.621501 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:33.621933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:33.622382 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lazy-loading 'fault' on Instance uuid f6995ac7-abff-47f3-a48c-a24fc437717e {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:03:33.669498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:33.679565 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4bd9cf44-28a6-4e39-bfd2-cd04d61f65dd tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 200 len: 1230 microversion: 2.1 time: 0.110196 Aug 10 17:03:33.682147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 541/1062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:33 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:34.703841 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:34.704709 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:34.711084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:34.711567 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:34.712008 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:34.712736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:34.713192 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:34.713618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:34.726730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] HTTP exception thrown: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Request method failure captured: Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e HTTP/1.1 Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-POFMQbrLZhi0ekXnpzfX-UTdvXoDzd7OKt3j0CDY7vdmo7zP-sGD3vYPJRAkoKUyO2fIpZto63yRhEIkqJ00cHxekSKFlaN0G-MagbXH5aSy-Tbx70UIz1yia9x5nBg51JauVhBjmKQHYBmRByk_pz4VLHtTzdpBF6qsxG2UN4D9E Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: 41311d9aa3f54596a61033b0ea82ba80 Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:03:34.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41311d9aa3f54596a61033b0ea82ba80", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: 41311d9aa3f54596a61033b0ea82ba80 Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-TestVolumeBootPattern-1712367006-project Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: a1c78f05a0f24151a1884faed65d286e Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-TestVolumeBootPattern-1712367006-project Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:03:34.730053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': 'f6995ac7-abff-47f3-a48c-a24fc437717e'} Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:03:34.731151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:03:34.732759 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:34.734076 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Returning 404 to user: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:03:34.734076 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5e0e52b5-ccc1-4041-9612-c2d4b54b056f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 404 len: 111 microversion: 2.1 time: 0.030911 Aug 10 17:03:34.734076 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 522/1063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:34 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:03:34.826196 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1459975192", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-465937417", "security_groups": [{"name": "tempest-secgroup-smoke-1125656476"}], "block_device_mapping_v2": [{"uuid": "574feaff-45fd-4867-9af6-ab8bd1fb91f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f5066015-605a-4fe4-890b-df73669544bb"}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:34.834838 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e30ba512-93b5-41a5-bc71-d988d1356434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:34.835338 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e30ba512-93b5-41a5-bc71-d988d1356434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:34.841315 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30ba512-93b5-41a5-bc71-d988d1356434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:34.841805 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30ba512-93b5-41a5-bc71-d988d1356434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:34.842240 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30ba512-93b5-41a5-bc71-d988d1356434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:34.842934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30ba512-93b5-41a5-bc71-d988d1356434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:34.843388 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30ba512-93b5-41a5-bc71-d988d1356434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:34.843813 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30ba512-93b5-41a5-bc71-d988d1356434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:34.869063 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e30ba512-93b5-41a5-bc71-d988d1356434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:03:34.939512 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] validate_networks() for [('f5066015-605a-4fe4-890b-df73669544bb', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:03:34.963617 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e30ba512-93b5-41a5-bc71-d988d1356434 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 204 len: 0 microversion: 2.1 time: 0.131987 Aug 10 17:03:34.963933 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 523/1064] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:03:34 2022] DELETE /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:03:34.973305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bf0011e7-9728-4bf0-8378-1966071eed77 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:34.974007 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bf0011e7-9728-4bf0-8378-1966071eed77 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:34.980653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf0011e7-9728-4bf0-8378-1966071eed77 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:34.981171 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf0011e7-9728-4bf0-8378-1966071eed77 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:34.981964 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf0011e7-9728-4bf0-8378-1966071eed77 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:34.982672 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf0011e7-9728-4bf0-8378-1966071eed77 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:34.983122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf0011e7-9728-4bf0-8378-1966071eed77 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:34.983545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf0011e7-9728-4bf0-8378-1966071eed77 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:35.123744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-bf0011e7-9728-4bf0-8378-1966071eed77 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:35.131247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bf0011e7-9728-4bf0-8378-1966071eed77 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1508 microversion: 2.1 time: 0.162805 Aug 10 17:03:35.132005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 524/1065] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:34 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:03:35.310632 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:03:35.311059 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:03:35.311528 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:03:35.311933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:03:35.312372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:03:35.321164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:35.321644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:35.322075 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:35.322804 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:35.323255 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:35.323677 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:35.340622 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Getting quotas for project 41311d9aa3f54596a61033b0ea82ba80. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:03:35.344495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Getting quotas for user a1c78f05a0f24151a1884faed65d286e and project 41311d9aa3f54596a61033b0ea82ba80. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:03:35.400177 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:03:35.402243 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='574feaff-45fd-4867-9af6-ab8bd1fb91f0',volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:03:35.540047 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0e8b3294-1823-40d4-87d3-22f08947251b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.717728 Aug 10 17:03:35.540726 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 542/1066] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 17:03:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:03:35.552005 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8c7b3c5a-5508-49e1-9cb7-e7d2b22410fc tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:35.552744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8c7b3c5a-5508-49e1-9cb7-e7d2b22410fc tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:35.616018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8c7b3c5a-5508-49e1-9cb7-e7d2b22410fc tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:35.622671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8c7b3c5a-5508-49e1-9cb7-e7d2b22410fc tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1094 microversion: 2.1 time: 0.074996 Aug 10 17:03:35.623234 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 525/1067] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:35 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:36.152186 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e9b0196a-df6e-4718-b57c-17a5e7dc98ab tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:36.152795 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e9b0196a-df6e-4718-b57c-17a5e7dc98ab tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:36.160504 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e9b0196a-df6e-4718-b57c-17a5e7dc98ab tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:36.160987 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e9b0196a-df6e-4718-b57c-17a5e7dc98ab tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:36.161415 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e9b0196a-df6e-4718-b57c-17a5e7dc98ab tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:36.162110 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e9b0196a-df6e-4718-b57c-17a5e7dc98ab tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:36.162561 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e9b0196a-df6e-4718-b57c-17a5e7dc98ab tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:36.162984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e9b0196a-df6e-4718-b57c-17a5e7dc98ab tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:36.362919 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e9b0196a-df6e-4718-b57c-17a5e7dc98ab tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:36.370288 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e9b0196a-df6e-4718-b57c-17a5e7dc98ab tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 200 len: 1508 microversion: 2.1 time: 0.222078 Aug 10 17:03:36.370849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 543/1068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:36 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:36.588231 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4c57b375-2e3a-4063-8681-cd7e8b235fa8 req-250260e0-c3ce-48e2-8503-59964d29b492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47c5a69-d424-4029-aa71-d2a0375d20cf", "name": "network-vif-deleted", "tag": "df7c9811-d38c-42e7-af16-56a3efaa2ab9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:36.602846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4c57b375-2e3a-4063-8681-cd7e8b235fa8 req-250260e0-c3ce-48e2-8503-59964d29b492 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:36.603642 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4c57b375-2e3a-4063-8681-cd7e8b235fa8 req-250260e0-c3ce-48e2-8503-59964d29b492 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:36.604264 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4c57b375-2e3a-4063-8681-cd7e8b235fa8 req-250260e0-c3ce-48e2-8503-59964d29b492 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:36.616504 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4c57b375-2e3a-4063-8681-cd7e8b235fa8 req-250260e0-c3ce-48e2-8503-59964d29b492 service nova] Creating event network-vif-deleted:df7c9811-d38c-42e7-af16-56a3efaa2ab9 for instance a47c5a69-d424-4029-aa71-d2a0375d20cf on hv-cinder-83602 Aug 10 17:03:36.625694 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4c57b375-2e3a-4063-8681-cd7e8b235fa8 req-250260e0-c3ce-48e2-8503-59964d29b492 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041316 Aug 10 17:03:36.627046 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 526/1069] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:03:36.643184 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f60f0d83-185d-4374-92ea-219af39bcf63 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:36.644981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f60f0d83-185d-4374-92ea-219af39bcf63 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:36.652110 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f60f0d83-185d-4374-92ea-219af39bcf63 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:36.652881 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f60f0d83-185d-4374-92ea-219af39bcf63 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:36.653491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f60f0d83-185d-4374-92ea-219af39bcf63 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:36.654967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f60f0d83-185d-4374-92ea-219af39bcf63 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:36.655901 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f60f0d83-185d-4374-92ea-219af39bcf63 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:36.656632 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f60f0d83-185d-4374-92ea-219af39bcf63 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:36.741090 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f60f0d83-185d-4374-92ea-219af39bcf63 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:36.748591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f60f0d83-185d-4374-92ea-219af39bcf63 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1192 microversion: 2.1 time: 0.109593 Aug 10 17:03:36.749150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 544/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:36 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1192 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:37.391677 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:37.392428 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: a47c5a69-d424-4029-aa71-d2a0375d20cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:37.399205 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:37.399706 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:37.400591 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:37.401306 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:37.401770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:37.402408 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:37.417834 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] HTTP exception thrown: Instance a47c5a69-d424-4029-aa71-d2a0375d20cf could not be found. Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Request method failure captured: Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf HTTP/1.1 Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lh1I9b-kzb_slWPvAVutdni9VM3659dFbvGG7qTcP042PDQs7hDKYwoJmH321qx5VWPk96Wr1z1hO4peTcy8akv6z-FleuR3FxKhnCOsmN7o9e6S20CSWhLrQ8J54JBEp1JiIbuk9o27XYyUSIPF3W2AYMFe1yND8oP5BURIf_OIQ Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: 36cf7bbfa5d3420996a2af036cf8e0da Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:03:37.419494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36cf7bbfa5d3420996a2af036cf8e0da", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: 36cf7bbfa5d3420996a2af036cf8e0da Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-ServerRescueNegativeTestJSON-1943156217-project Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: c7fac765624c4e0b85b01f356a14a1cb Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1943156217-project Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance a47c5a69-d424-4029-aa71-d2a0375d20cf could not be found. Aug 10 17:03:37.421145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': 'a47c5a69-d424-4029-aa71-d2a0375d20cf'} Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47c5a69-d424-4029-aa71-d2a0375d20cf could not be found. Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:03:37.422125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47c5a69-d424-4029-aa71-d2a0375d20cf could not be found. Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47c5a69-d424-4029-aa71-d2a0375d20cf could not be found. Aug 10 17:03:37.423486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:37.429443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Returning 404 to user: Instance a47c5a69-d424-4029-aa71-d2a0375d20cf could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:03:37.429443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ccba821e-1545-459e-8fdc-8cb7a4838a81 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf" status: 404 len: 111 microversion: 2.1 time: 0.033746 Aug 10 17:03:37.429443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 527/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:37 2022] GET /compute/v2.1/servers/a47c5a69-d424-4029-aa71-d2a0375d20cf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:03:37.431699 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-756dcdcc-c557-4c86-b67b-42cf36afb911 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:37.432242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-756dcdcc-c557-4c86-b67b-42cf36afb911 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:37.438655 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-756dcdcc-c557-4c86-b67b-42cf36afb911 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:37.439153 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-756dcdcc-c557-4c86-b67b-42cf36afb911 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:37.439594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-756dcdcc-c557-4c86-b67b-42cf36afb911 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:37.440334 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-756dcdcc-c557-4c86-b67b-42cf36afb911 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:37.441279 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-756dcdcc-c557-4c86-b67b-42cf36afb911 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:37.441706 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-756dcdcc-c557-4c86-b67b-42cf36afb911 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:37.469367 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-756dcdcc-c557-4c86-b67b-42cf36afb911 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:03:37.549344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-756dcdcc-c557-4c86-b67b-42cf36afb911 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 204 len: 0 microversion: 2.1 time: 0.123106 Aug 10 17:03:37.553233 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 545/1072] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:03:37 2022] DELETE /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:03:37.558403 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5d35eaf1-e91b-4578-a156-0870683263a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:37.559128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5d35eaf1-e91b-4578-a156-0870683263a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:37.565037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d35eaf1-e91b-4578-a156-0870683263a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:37.565597 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d35eaf1-e91b-4578-a156-0870683263a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:37.566604 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d35eaf1-e91b-4578-a156-0870683263a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:37.567455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d35eaf1-e91b-4578-a156-0870683263a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:37.567981 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d35eaf1-e91b-4578-a156-0870683263a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:37.568503 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d35eaf1-e91b-4578-a156-0870683263a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:37.716738 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5d35eaf1-e91b-4578-a156-0870683263a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:37.725030 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5d35eaf1-e91b-4578-a156-0870683263a6 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.170437 Aug 10 17:03:37.725641 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 528/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:37 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:37.770803 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e6818c47-7496-41fb-bd75-e5f9683b5276 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:37.771778 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e6818c47-7496-41fb-bd75-e5f9683b5276 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:37.778367 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6818c47-7496-41fb-bd75-e5f9683b5276 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:37.778863 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6818c47-7496-41fb-bd75-e5f9683b5276 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:37.779336 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6818c47-7496-41fb-bd75-e5f9683b5276 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:37.780053 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6818c47-7496-41fb-bd75-e5f9683b5276 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:37.780565 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6818c47-7496-41fb-bd75-e5f9683b5276 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:37.780995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6818c47-7496-41fb-bd75-e5f9683b5276 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:38.017719 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e6818c47-7496-41fb-bd75-e5f9683b5276 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:38.026758 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e6818c47-7496-41fb-bd75-e5f9683b5276 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1278 microversion: 2.1 time: 0.260357 Aug 10 17:03:38.027584 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 546/1074] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:37 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:38.670983 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-521b595d-8b53-40b8-a29a-3e37b416df80 req-2d5b12f1-a9c7-4003-9b69-4ab6ef3c9fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44756d90-0dd3-4231-a768-4460a6749013", "tag": "549da651-b25e-4fad-ae25-10f3ee253154"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:38.681050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-521b595d-8b53-40b8-a29a-3e37b416df80 req-2d5b12f1-a9c7-4003-9b69-4ab6ef3c9fb0 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:38.681913 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-521b595d-8b53-40b8-a29a-3e37b416df80 req-2d5b12f1-a9c7-4003-9b69-4ab6ef3c9fb0 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:38.682406 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-521b595d-8b53-40b8-a29a-3e37b416df80 req-2d5b12f1-a9c7-4003-9b69-4ab6ef3c9fb0 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:38.694692 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-521b595d-8b53-40b8-a29a-3e37b416df80 req-2d5b12f1-a9c7-4003-9b69-4ab6ef3c9fb0 service nova] Creating event network-changed:549da651-b25e-4fad-ae25-10f3ee253154 for instance 44756d90-0dd3-4231-a768-4460a6749013 on hv-cinder-83602 Aug 10 17:03:38.699563 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-521b595d-8b53-40b8-a29a-3e37b416df80 req-2d5b12f1-a9c7-4003-9b69-4ab6ef3c9fb0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032278 Aug 10 17:03:38.700182 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 529/1075] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:03:38.746801 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-40efc15d-da99-4a9a-9fbd-c49de9267923 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:38.747415 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-40efc15d-da99-4a9a-9fbd-c49de9267923 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:38.755034 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40efc15d-da99-4a9a-9fbd-c49de9267923 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:38.755527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40efc15d-da99-4a9a-9fbd-c49de9267923 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:38.755962 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40efc15d-da99-4a9a-9fbd-c49de9267923 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:38.756891 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40efc15d-da99-4a9a-9fbd-c49de9267923 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:38.757352 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40efc15d-da99-4a9a-9fbd-c49de9267923 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:38.757776 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40efc15d-da99-4a9a-9fbd-c49de9267923 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:38.948305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-40efc15d-da99-4a9a-9fbd-c49de9267923 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:38.957032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-40efc15d-da99-4a9a-9fbd-c49de9267923 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1522 microversion: 2.1 time: 0.213619 Aug 10 17:03:38.970799 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 547/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:38 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:39.051323 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08eaefa8-694b-4bfb-b4fc-7ffced7feba9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:39.052049 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08eaefa8-694b-4bfb-b4fc-7ffced7feba9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:39.058259 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08eaefa8-694b-4bfb-b4fc-7ffced7feba9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:39.058749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08eaefa8-694b-4bfb-b4fc-7ffced7feba9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:39.059193 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08eaefa8-694b-4bfb-b4fc-7ffced7feba9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:39.059890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08eaefa8-694b-4bfb-b4fc-7ffced7feba9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:39.060382 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08eaefa8-694b-4bfb-b4fc-7ffced7feba9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:39.060815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08eaefa8-694b-4bfb-b4fc-7ffced7feba9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:39.075593 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:39.196095 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-08eaefa8-694b-4bfb-b4fc-7ffced7feba9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:39.203583 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08eaefa8-694b-4bfb-b4fc-7ffced7feba9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1266 microversion: 2.1 time: 0.156457 Aug 10 17:03:39.204076 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 530/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:39 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:39.978546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-93bae9d4-57e2-4cd2-ad20-b9e056de3d12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:39.979172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-93bae9d4-57e2-4cd2-ad20-b9e056de3d12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:39.985559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93bae9d4-57e2-4cd2-ad20-b9e056de3d12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:39.986058 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93bae9d4-57e2-4cd2-ad20-b9e056de3d12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:39.986468 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93bae9d4-57e2-4cd2-ad20-b9e056de3d12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:39.987147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93bae9d4-57e2-4cd2-ad20-b9e056de3d12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:39.987600 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93bae9d4-57e2-4cd2-ad20-b9e056de3d12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:39.988013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93bae9d4-57e2-4cd2-ad20-b9e056de3d12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:40.052734 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-93bae9d4-57e2-4cd2-ad20-b9e056de3d12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:40.060038 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-93bae9d4-57e2-4cd2-ad20-b9e056de3d12 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1480 microversion: 2.1 time: 0.085357 Aug 10 17:03:40.060634 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 548/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:39 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1480 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:40.224432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67224ae4-0511-4fdc-8e00-d331841877b9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:40.225048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-67224ae4-0511-4fdc-8e00-d331841877b9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:40.232042 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67224ae4-0511-4fdc-8e00-d331841877b9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:40.232602 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67224ae4-0511-4fdc-8e00-d331841877b9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:40.232985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67224ae4-0511-4fdc-8e00-d331841877b9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:40.233708 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67224ae4-0511-4fdc-8e00-d331841877b9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:40.234213 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67224ae4-0511-4fdc-8e00-d331841877b9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:40.234653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67224ae4-0511-4fdc-8e00-d331841877b9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:40.365084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-67224ae4-0511-4fdc-8e00-d331841877b9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:40.372454 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67224ae4-0511-4fdc-8e00-d331841877b9 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1266 microversion: 2.1 time: 0.151954 Aug 10 17:03:40.373012 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 531/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:40 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:40.714595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-5118db61-291a-4a63-b438-4d0d5405608d req-f89a54e5-1627-4984-ad9f-32443a431906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8017eb-1d19-483c-b2ee-e5d8b07b16e9", "name": "network-vif-deleted", "tag": "a1ea9959-841c-429c-a71e-74b97583bc3f"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:40.724483 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5118db61-291a-4a63-b438-4d0d5405608d req-f89a54e5-1627-4984-ad9f-32443a431906 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:40.724957 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5118db61-291a-4a63-b438-4d0d5405608d req-f89a54e5-1627-4984-ad9f-32443a431906 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:40.725378 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5118db61-291a-4a63-b438-4d0d5405608d req-f89a54e5-1627-4984-ad9f-32443a431906 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:40.737115 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-5118db61-291a-4a63-b438-4d0d5405608d req-f89a54e5-1627-4984-ad9f-32443a431906 service nova] Creating event network-vif-deleted:a1ea9959-841c-429c-a71e-74b97583bc3f for instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 on hv-cinder-83602 Aug 10 17:03:40.742506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-5118db61-291a-4a63-b438-4d0d5405608d req-f89a54e5-1627-4984-ad9f-32443a431906 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032009 Aug 10 17:03:40.743332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 549/1080] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:03:41.080919 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:41.081576 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:41.087881 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:41.088399 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:41.088844 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:41.089539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:41.089995 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:41.090447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:41.120606 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:41.121088 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:41.121524 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:41.121967 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lazy-loading 'fault' on Instance uuid cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:03:41.164700 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:41.172012 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-77119339-4be9-4795-aa74-8bce20768753 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1312 microversion: 2.1 time: 0.095188 Aug 10 17:03:41.172603 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 532/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:41 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:41.393376 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-16b08be8-81be-40e6-bceb-54f3ca9dd661 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:41.394005 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-16b08be8-81be-40e6-bceb-54f3ca9dd661 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:41.400527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16b08be8-81be-40e6-bceb-54f3ca9dd661 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:41.400997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16b08be8-81be-40e6-bceb-54f3ca9dd661 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:41.401425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16b08be8-81be-40e6-bceb-54f3ca9dd661 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:41.402101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16b08be8-81be-40e6-bceb-54f3ca9dd661 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:41.402543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16b08be8-81be-40e6-bceb-54f3ca9dd661 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:41.402961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16b08be8-81be-40e6-bceb-54f3ca9dd661 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:41.533934 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-16b08be8-81be-40e6-bceb-54f3ca9dd661 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:41.541790 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-16b08be8-81be-40e6-bceb-54f3ca9dd661 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1266 microversion: 2.1 time: 0.153321 Aug 10 17:03:41.542351 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 550/1082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:41 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:42.194570 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:42.195224 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:42.202308 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:42.203910 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:42.204770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:42.205483 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:42.206077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:42.206505 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:42.249957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:42.251638 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:42.252432 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:42.254478 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lazy-loading 'fault' on Instance uuid cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:03:42.312032 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fac765624c4e0b85b01f356a14a1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cf7bbfa5d3420996a2af036cf8e0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:42.319823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-032dcf66-71e4-44ae-b209-ecd96fe6fc54 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 200 len: 1312 microversion: 2.1 time: 0.130306 Aug 10 17:03:42.321247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 533/1083] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:42 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:42.562425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-29d7b31d-ec31-49e7-9cd3-522177bd70b1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:42.563042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-29d7b31d-ec31-49e7-9cd3-522177bd70b1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:42.565579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:42.571483 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29d7b31d-ec31-49e7-9cd3-522177bd70b1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:42.572013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29d7b31d-ec31-49e7-9cd3-522177bd70b1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:42.572482 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29d7b31d-ec31-49e7-9cd3-522177bd70b1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:42.573193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29d7b31d-ec31-49e7-9cd3-522177bd70b1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:42.573647 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29d7b31d-ec31-49e7-9cd3-522177bd70b1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:42.574075 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29d7b31d-ec31-49e7-9cd3-522177bd70b1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:42.791909 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-29d7b31d-ec31-49e7-9cd3-522177bd70b1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:42.799526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-29d7b31d-ec31-49e7-9cd3-522177bd70b1 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1266 microversion: 2.1 time: 0.241113 Aug 10 17:03:42.800089 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 551/1084] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:42 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:43.341540 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:43.342153 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] [instance: cf8017eb-1d19-483c-b2ee-e5d8b07b16e9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:43.344490 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:43.351148 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:43.351779 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:43.352251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:43.352952 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:43.353412 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:43.353841 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:43.369180 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] HTTP exception thrown: Instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 could not be found. Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Request method failure captured: Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 HTTP/1.1 Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lh1I9b-kzb_slWPvAVutdni9VM3659dFbvGG7qTcP042PDQs7hDKYwoJmH321qx5VWPk96Wr1z1hO4peTcy8akv6z-FleuR3FxKhnCOsmN7o9e6S20CSWhLrQ8J54JBEp1JiIbuk9o27XYyUSIPF3W2AYMFe1yND8oP5BURIf_OIQ Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: 36cf7bbfa5d3420996a2af036cf8e0da Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:03:43.370806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36cf7bbfa5d3420996a2af036cf8e0da", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36cf7bbfa5d3420996a2af036cf8e0da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: 36cf7bbfa5d3420996a2af036cf8e0da Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1943156217 Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-ServerRescueNegativeTestJSON-1943156217-project Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: c7fac765624c4e0b85b01f356a14a1cb Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1943156217-project Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 could not be found. Aug 10 17:03:43.372347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': 'cf8017eb-1d19-483c-b2ee-e5d8b07b16e9'} Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 could not be found. Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:03:43.373209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 could not be found. Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 could not be found. Aug 10 17:03:43.374640 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:03:43.375949 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] Returning 404 to user: Instance cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:03:43.375949 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-45692cef-43bd-4df0-ac15-950666ff69a0 tempest-ServerRescueNegativeTestJSON-1943156217 tempest-ServerRescueNegativeTestJSON-1943156217-project] 10.222.0.25 "GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9" status: 404 len: 111 microversion: 2.1 time: 0.034613 Aug 10 17:03:43.375949 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 534/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:43 2022] GET /compute/v2.1/servers/cf8017eb-1d19-483c-b2ee-e5d8b07b16e9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:03:43.821408 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a8b64a65-abad-4f3b-81eb-b8d1314d0705 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:43.821933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a8b64a65-abad-4f3b-81eb-b8d1314d0705 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:43.828906 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8b64a65-abad-4f3b-81eb-b8d1314d0705 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:43.829391 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8b64a65-abad-4f3b-81eb-b8d1314d0705 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:43.829819 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8b64a65-abad-4f3b-81eb-b8d1314d0705 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:43.830509 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8b64a65-abad-4f3b-81eb-b8d1314d0705 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:43.830955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8b64a65-abad-4f3b-81eb-b8d1314d0705 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:43.831373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8b64a65-abad-4f3b-81eb-b8d1314d0705 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:44.076864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a8b64a65-abad-4f3b-81eb-b8d1314d0705 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:44.086185 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a8b64a65-abad-4f3b-81eb-b8d1314d0705 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1266 microversion: 2.1 time: 0.269377 Aug 10 17:03:44.086764 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 552/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:43 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:44.403575 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9317e018-9768-4f6d-9332-594c75c091bb req-2d218e1f-1c40-4055-b1e2-e77871c74140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44756d90-0dd3-4231-a768-4460a6749013", "name": "network-vif-plugged", "status": "completed", "tag": "549da651-b25e-4fad-ae25-10f3ee253154"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:44.417075 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9317e018-9768-4f6d-9332-594c75c091bb req-2d218e1f-1c40-4055-b1e2-e77871c74140 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:44.417590 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9317e018-9768-4f6d-9332-594c75c091bb req-2d218e1f-1c40-4055-b1e2-e77871c74140 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:44.418130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9317e018-9768-4f6d-9332-594c75c091bb req-2d218e1f-1c40-4055-b1e2-e77871c74140 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:44.439591 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9317e018-9768-4f6d-9332-594c75c091bb req-2d218e1f-1c40-4055-b1e2-e77871c74140 service nova] Creating event network-vif-plugged:549da651-b25e-4fad-ae25-10f3ee253154 for instance 44756d90-0dd3-4231-a768-4460a6749013 on hv-cinder-83602 Aug 10 17:03:44.444731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9317e018-9768-4f6d-9332-594c75c091bb req-2d218e1f-1c40-4055-b1e2-e77871c74140 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045861 Aug 10 17:03:44.445622 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 535/1087] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:03:45.107284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e3c40289-2375-4bc0-9dce-16d39b368057 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:45.107901 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e3c40289-2375-4bc0-9dce-16d39b368057 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:45.116118 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3c40289-2375-4bc0-9dce-16d39b368057 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:45.116742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3c40289-2375-4bc0-9dce-16d39b368057 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:45.117249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3c40289-2375-4bc0-9dce-16d39b368057 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:45.118091 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3c40289-2375-4bc0-9dce-16d39b368057 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:45.119368 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3c40289-2375-4bc0-9dce-16d39b368057 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:45.119884 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e3c40289-2375-4bc0-9dce-16d39b368057 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:45.307299 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6cad20bb-1569-4380-8a0d-f4da71d28e86 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:45.309702 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6cad20bb-1569-4380-8a0d-f4da71d28e86 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:45.316163 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cad20bb-1569-4380-8a0d-f4da71d28e86 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:45.316850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cad20bb-1569-4380-8a0d-f4da71d28e86 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:45.317483 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cad20bb-1569-4380-8a0d-f4da71d28e86 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:45.318451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cad20bb-1569-4380-8a0d-f4da71d28e86 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:45.319011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cad20bb-1569-4380-8a0d-f4da71d28e86 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:45.319655 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cad20bb-1569-4380-8a0d-f4da71d28e86 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:45.331037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:45.346917 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e3c40289-2375-4bc0-9dce-16d39b368057 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:45.353396 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6cad20bb-1569-4380-8a0d-f4da71d28e86 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050874 Aug 10 17:03:45.356641 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:45.359828 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e3c40289-2375-4bc0-9dce-16d39b368057 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1266 microversion: 2.1 time: 0.256653 Aug 10 17:03:45.362206 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 553/1088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:45 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:45.362597 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 536/1089] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:03:45 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 17:03:45.420639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-11514ffb-a2a9-414a-9bde-0dc134b63842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:45.421442 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-11514ffb-a2a9-414a-9bde-0dc134b63842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:45.427967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11514ffb-a2a9-414a-9bde-0dc134b63842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:45.428822 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11514ffb-a2a9-414a-9bde-0dc134b63842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:45.429503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11514ffb-a2a9-414a-9bde-0dc134b63842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:45.430463 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11514ffb-a2a9-414a-9bde-0dc134b63842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:45.431023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11514ffb-a2a9-414a-9bde-0dc134b63842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:45.431668 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11514ffb-a2a9-414a-9bde-0dc134b63842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:45.459862 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-11514ffb-a2a9-414a-9bde-0dc134b63842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:03:45.549039 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-11514ffb-a2a9-414a-9bde-0dc134b63842 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 204 len: 0 microversion: 2.1 time: 0.131811 Aug 10 17:03:45.552588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 554/1090] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:03:45 2022] DELETE /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:03:45.559139 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02070f9a-91e8-4313-9d44-8a29d10da814 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:45.559549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-02070f9a-91e8-4313-9d44-8a29d10da814 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:45.566297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02070f9a-91e8-4313-9d44-8a29d10da814 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:45.566798 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02070f9a-91e8-4313-9d44-8a29d10da814 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:45.567239 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02070f9a-91e8-4313-9d44-8a29d10da814 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:45.567942 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02070f9a-91e8-4313-9d44-8a29d10da814 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:45.568431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02070f9a-91e8-4313-9d44-8a29d10da814 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:45.568859 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02070f9a-91e8-4313-9d44-8a29d10da814 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:45.620040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:45.703704 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-02070f9a-91e8-4313-9d44-8a29d10da814 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:45.711729 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-02070f9a-91e8-4313-9d44-8a29d10da814 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1674 microversion: 2.1 time: 0.157146 Aug 10 17:03:45.712270 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 537/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:45 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:46.383473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-881b0693-4fa2-4286-9976-1283d96be831 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:46.384192 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-881b0693-4fa2-4286-9976-1283d96be831 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:46.391455 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-881b0693-4fa2-4286-9976-1283d96be831 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:46.391954 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-881b0693-4fa2-4286-9976-1283d96be831 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:46.392415 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-881b0693-4fa2-4286-9976-1283d96be831 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:46.393119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-881b0693-4fa2-4286-9976-1283d96be831 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:46.393571 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-881b0693-4fa2-4286-9976-1283d96be831 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:46.393997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-881b0693-4fa2-4286-9976-1283d96be831 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:46.418176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:46.579300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-881b0693-4fa2-4286-9976-1283d96be831 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:46.587995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-881b0693-4fa2-4286-9976-1283d96be831 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1266 microversion: 2.1 time: 0.209315 Aug 10 17:03:46.600982 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 555/1092] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:46 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:46.733557 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-75e0776a-0129-4d9b-b506-ed8311b99714 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:46.734208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-75e0776a-0129-4d9b-b506-ed8311b99714 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:46.741342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75e0776a-0129-4d9b-b506-ed8311b99714 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:46.741716 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75e0776a-0129-4d9b-b506-ed8311b99714 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:46.742166 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75e0776a-0129-4d9b-b506-ed8311b99714 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:46.742867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75e0776a-0129-4d9b-b506-ed8311b99714 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:46.743502 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75e0776a-0129-4d9b-b506-ed8311b99714 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:46.743938 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75e0776a-0129-4d9b-b506-ed8311b99714 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:46.891456 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-75e0776a-0129-4d9b-b506-ed8311b99714 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:46.899547 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-75e0776a-0129-4d9b-b506-ed8311b99714 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1674 microversion: 2.1 time: 0.169837 Aug 10 17:03:46.900690 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 538/1093] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:46 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:47.608304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fda8713e-a1c8-4eb9-b275-2dfe3f95ad0d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:47.608917 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fda8713e-a1c8-4eb9-b275-2dfe3f95ad0d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:47.615482 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fda8713e-a1c8-4eb9-b275-2dfe3f95ad0d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:47.615968 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fda8713e-a1c8-4eb9-b275-2dfe3f95ad0d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:47.616428 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fda8713e-a1c8-4eb9-b275-2dfe3f95ad0d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:47.617121 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fda8713e-a1c8-4eb9-b275-2dfe3f95ad0d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:47.617572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fda8713e-a1c8-4eb9-b275-2dfe3f95ad0d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:47.617998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fda8713e-a1c8-4eb9-b275-2dfe3f95ad0d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:47.752546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fda8713e-a1c8-4eb9-b275-2dfe3f95ad0d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:47.770689 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fda8713e-a1c8-4eb9-b275-2dfe3f95ad0d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1452 microversion: 2.1 time: 0.166040 Aug 10 17:03:47.773651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 556/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:47 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:47.791518 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ec374c2e-1f3a-464f-90a7-2e2c0b53579f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:47.792073 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ec374c2e-1f3a-464f-90a7-2e2c0b53579f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:47.797948 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec374c2e-1f3a-464f-90a7-2e2c0b53579f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:47.798475 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec374c2e-1f3a-464f-90a7-2e2c0b53579f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:47.798885 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec374c2e-1f3a-464f-90a7-2e2c0b53579f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:47.799582 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec374c2e-1f3a-464f-90a7-2e2c0b53579f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:47.800040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec374c2e-1f3a-464f-90a7-2e2c0b53579f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:47.800496 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec374c2e-1f3a-464f-90a7-2e2c0b53579f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:47.852850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b00c9d4-317a-4f73-9cb4-62f272baafc5 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] Action: 'create', calling method: .version_select at 0x7f5b0848a1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2140202656", "metadata": {"Type": "work"}}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:48.035490 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ec374c2e-1f3a-464f-90a7-2e2c0b53579f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:48.044031 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ec374c2e-1f3a-464f-90a7-2e2c0b53579f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1452 microversion: 2.1 time: 0.256322 Aug 10 17:03:48.044689 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 557/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:47 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1452 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:48.065781 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3ee569b3-fb23-4b86-99a5-1f3b27470251 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:48.066539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3ee569b3-fb23-4b86-99a5-1f3b27470251 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:48.075472 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ee569b3-fb23-4b86-99a5-1f3b27470251 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:48.075964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ee569b3-fb23-4b86-99a5-1f3b27470251 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:48.077541 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ee569b3-fb23-4b86-99a5-1f3b27470251 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:48.080429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ee569b3-fb23-4b86-99a5-1f3b27470251 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:48.080429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ee569b3-fb23-4b86-99a5-1f3b27470251 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:48.080429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3ee569b3-fb23-4b86-99a5-1f3b27470251 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:48.202733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b00c9d4-317a-4f73-9cb4-62f272baafc5 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.504319 Aug 10 17:03:48.211712 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 539/1096] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Aug 10 17:03:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 506 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 17:03:48.217671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45be12e4-cd33-4f54-a7ba-b40e8f3c2bae tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] Calling method '.version_select at 0x7f5b0cad3940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:48.271385 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-45be12e4-cd33-4f54-a7ba-b40e8f3c2bae tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7" status: 200 len: 353 microversion: 2.1 time: 0.058379 Aug 10 17:03:48.273492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 540/1097] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 17:03:48 2022] GET /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:03:48.365260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3ee569b3-fb23-4b86-99a5-1f3b27470251 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:48.373890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3ee569b3-fb23-4b86-99a5-1f3b27470251 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1674 microversion: 2.1 time: 0.316064 Aug 10 17:03:48.374612 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 558/1098] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:48 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1674 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:49.137180 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-995cd5df-18a0-4102-b299-a130d3873f18 req-78ec04cc-2286-4b5e-a677-585c2fca7aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a08fd38-1ced-4301-a089-e789299f3104", "name": "network-vif-deleted", "tag": "52b5a2cd-c933-4bfa-b4b5-c66a8d99308a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:49.146852 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-995cd5df-18a0-4102-b299-a130d3873f18 req-78ec04cc-2286-4b5e-a677-585c2fca7aa4 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:49.147486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-995cd5df-18a0-4102-b299-a130d3873f18 req-78ec04cc-2286-4b5e-a677-585c2fca7aa4 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:49.148041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-995cd5df-18a0-4102-b299-a130d3873f18 req-78ec04cc-2286-4b5e-a677-585c2fca7aa4 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:49.166467 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-995cd5df-18a0-4102-b299-a130d3873f18 req-78ec04cc-2286-4b5e-a677-585c2fca7aa4 service nova] Creating event network-vif-deleted:52b5a2cd-c933-4bfa-b4b5-c66a8d99308a for instance 2a08fd38-1ced-4301-a089-e789299f3104 on hv-cinder-83602 Aug 10 17:03:49.172671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-995cd5df-18a0-4102-b299-a130d3873f18 req-78ec04cc-2286-4b5e-a677-585c2fca7aa4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041450 Aug 10 17:03:49.173809 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 541/1099] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:03:49.289034 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-46c8edaf-e645-47d1-bdb5-acc6abfb7799 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] Calling method '.version_select at 0x7f5b0c9ab700>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:49.375879 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-46c8edaf-e645-47d1-bdb5-acc6abfb7799 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7" status: 200 len: 354 microversion: 2.1 time: 0.092424 Aug 10 17:03:49.378096 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 559/1100] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 17:03:49 2022] GET /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:03:49.395653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e5a65e28-9789-4d60-b3ba-400d9f8c4c4a tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] Calling method '.version_select at 0x7f5b0848ab80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:49.399697 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:49.406823 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:49.419619 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:49.420418 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:49.420872 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:49.421674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:49.422010 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:49.422660 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:49.469809 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e5a65e28-9789-4d60-b3ba-400d9f8c4c4a tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7" status: 200 len: 354 microversion: 2.1 time: 0.081160 Aug 10 17:03:49.471472 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 542/1101] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 17:03:49 2022] GET /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:03:49.482746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:49.482746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:49.482746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:49.482746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lazy-loading 'fault' on Instance uuid 2a08fd38-1ced-4301-a089-e789299f3104 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:03:49.491984 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f7964d4-c37a-4b16-ae05-a9daf3123bc3 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] Calling method '.version_select at 0x7f5b0cad3940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:49.534391 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:49.546445 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-af422b1c-6095-4c0f-a03f-27960b9738a9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 200 len: 1327 microversion: 2.1 time: 0.151480 Aug 10 17:03:49.547280 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 560/1102] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:49 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 1327 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:49.570588 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f7964d4-c37a-4b16-ae05-a9daf3123bc3 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7" status: 202 len: 0 microversion: 2.1 time: 0.082963 Aug 10 17:03:49.571693 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 543/1103] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 10 17:03:49 2022] DELETE /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:03:49.580088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b1c0dfa7-b519-49b8-a209-d75204581042 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] Calling method '.version_select at 0x7f5b0cba0790>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:49.637749 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b1c0dfa7-b519-49b8-a209-d75204581042 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7" status: 200 len: 353 microversion: 2.1 time: 0.061659 Aug 10 17:03:49.638537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 561/1104] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 17:03:49 2022] GET /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:03:50.134656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a57bf065-5b8a-4ddf-9be2-278e84be0248 req-886b3cef-00ad-4e89-a3df-27818c803dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44756d90-0dd3-4231-a768-4460a6749013", "tag": "549da651-b25e-4fad-ae25-10f3ee253154"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:50.146388 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a57bf065-5b8a-4ddf-9be2-278e84be0248 req-886b3cef-00ad-4e89-a3df-27818c803dd5 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:50.147041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a57bf065-5b8a-4ddf-9be2-278e84be0248 req-886b3cef-00ad-4e89-a3df-27818c803dd5 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:50.147210 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a57bf065-5b8a-4ddf-9be2-278e84be0248 req-886b3cef-00ad-4e89-a3df-27818c803dd5 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:50.163276 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a57bf065-5b8a-4ddf-9be2-278e84be0248 req-886b3cef-00ad-4e89-a3df-27818c803dd5 service nova] Creating event network-changed:549da651-b25e-4fad-ae25-10f3ee253154 for instance 44756d90-0dd3-4231-a768-4460a6749013 on hv-cinder-83602 Aug 10 17:03:50.169991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a57bf065-5b8a-4ddf-9be2-278e84be0248 req-886b3cef-00ad-4e89-a3df-27818c803dd5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038932 Aug 10 17:03:50.170903 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 544/1105] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:03:50.569742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:50.570640 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:50.577536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:50.578361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:50.578831 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:50.579733 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:50.580438 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:50.580915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:50.600197 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] HTTP exception thrown: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Request method failure captured: Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 HTTP/1.1 Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lzvi5Y9WNdbMyOQTzBnMNK8qJj8ppZXYItuHXJUyx4ludzIbx2ahcxIbTxRgTLsHeeC1T7BjR3BVnB4UnQy1Tddxccthhqc71F7IKh8JCs6wkEKQi-4NQl5jG8_Hef3W508KJtvUnsAZh_H0zaCbGdbXVJI90339SwZdwdSEyvM_g Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:03:50.601892 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c11dfd80b6c544f6b87a58d5a25c5649", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 77b8847d10744ec98e0ed7a3f1e991ed Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:03:50.603339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '2a08fd38-1ced-4301-a089-e789299f3104'} Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:03:50.607523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:03:50.608837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.609967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Returning 404 to user: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:03:50.609967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e5b94970-38ea-4a41-ae92-6276ddde35f7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 404 len: 111 microversion: 2.1 time: 0.038155 Aug 10 17:03:50.609967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 562/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:50 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:03:50.612779 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2ae0cb0c-a7b3-4bda-954f-783f0eb1c0d3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '.version_select at 0x7f5b0848a310>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:50.632075 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2ae0cb0c-a7b3-4bda-954f-783f0eb1c0d3 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-854479938" status: 202 len: 0 microversion: 2.1 time: 0.023400 Aug 10 17:03:50.633129 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 545/1107] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Aug 10 17:03:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-854479938 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:03:50.652779 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9e99025e-3a55-42f7-bfa2-8974cc7d4155 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] Calling method '.version_select at 0x7f5b0cb4eb80>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:50.685735 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-9e99025e-3a55-42f7-bfa2-8974cc7d4155 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] HTTP exception thrown: Volume 048c7937-5eb2-47e1-960a-f8fc96be04c7 could not be found. Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9e99025e-3a55-42f7-bfa2-8974cc7d4155 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] Request method failure captured: Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7 HTTP/1.1 Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-TzjG7e7wxPKZPmCboCONZqA-80LUF9So4qe1FcfppepYdYnxLV8Gu4Zu8R5V101Jx0DBn3XPCaOLRCDiUmGsZw39QDLbJgFJDhMhTdLfubQ7GlTCsYsJ5NHlRgKmXMbTpoHYU2JTNsxUE37BkVa7Zc6QNdsRsqOJNC04fzgr8HIjY Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 045ddbc4de514d4b93c57d9c4bf9fa1a Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesGetTestJSON-1011292048 Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:03:50.690327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_045ddbc4de514d4b93c57d9c4bf9fa1a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/045ddbc4de514d4b93c57d9c4bf9fa1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/045ddbc4de514d4b93c57d9c4bf9fa1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/045ddbc4de514d4b93c57d9c4bf9fa1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesGetTestJSON-1011292048 Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 045ddbc4de514d4b93c57d9c4bf9fa1a Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesGetTestJSON-1011292048 Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesGetTestJSON-1011292048-project Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 3f76da26f5f74b82b7c12c0da990f0c7 Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesGetTestJSON-1011292048-project Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Volume 048c7937-5eb2-47e1-960a-f8fc96be04c7 could not be found. Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '048c7937-5eb2-47e1-960a-f8fc96be04c7'} Aug 10 17:03:50.693410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 048c7937-5eb2-47e1-960a-f8fc96be04c7 could not be found. (HTTP 404) (Request-ID: req-07be4ee5-1f60-4b21-a7be-9565f89cd99a) Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:50.694410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:03:50.695601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 048c7937-5eb2-47e1-960a-f8fc96be04c7 could not be found. Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 17:03:50.698397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:03:50.701088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 048c7937-5eb2-47e1-960a-f8fc96be04c7 could not be found. Aug 10 17:03:50.701088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.701088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:03:50.701088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.701088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:03:50.701088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:03:50.701088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:03:50.701088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:03:50.701088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:03:50.701088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 048c7937-5eb2-47e1-960a-f8fc96be04c7 could not be found. Aug 10 17:03:50.701088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:03:50.704467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9e99025e-3a55-42f7-bfa2-8974cc7d4155 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] Returning 404 to user: Volume 048c7937-5eb2-47e1-960a-f8fc96be04c7 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:03:50.706104 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9e99025e-3a55-42f7-bfa2-8974cc7d4155 tempest-VolumesGetTestJSON-1011292048 tempest-VolumesGetTestJSON-1011292048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7" status: 404 len: 109 microversion: 2.1 time: 0.057341 Aug 10 17:03:50.707933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 563/1108] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 17:03:50 2022] GET /compute/v2.1/os-volumes/048c7937-5eb2-47e1-960a-f8fc96be04c7 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:03:51.386458 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d51e5a3-1bd0-445e-9047-b927c7cbf3ef tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Action: 'create', calling method: .version_select at 0x7f5b08327940>, body: {"keypair": {"name": "tempest-keypair-1631067838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbNxVh0UMBARIkBxkK/yTi4k3j2Q2zEWjwivC+7Pic1zW6LE+zlqNAeX8gUtGmwzfGtcpXnJ3WtqmTeruaXZd+kSa7NWrpjjELpQSPBng9mBacadK3gPVobQD6tWIXEdw=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:51.403125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-1d51e5a3-1bd0-445e-9047-b927c7cbf3ef tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Getting quotas for project c11dfd80b6c544f6b87a58d5a25c5649. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:03:51.407070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-1d51e5a3-1bd0-445e-9047-b927c7cbf3ef tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Getting quotas for user 77b8847d10744ec98e0ed7a3f1e991ed and project c11dfd80b6c544f6b87a58d5a25c5649. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:03:51.431119 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d51e5a3-1bd0-445e-9047-b927c7cbf3ef tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049165 Aug 10 17:03:51.431723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 546/1109] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 10 17:03:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:03:52.790882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-158295625", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b9d3b9d-33b4-42c3-8ca9-050f1e19ea7c"}], "security_groups": [{"name": "tempest-securitygroup--510213303"}], "key_name": "tempest-keypair-1631067838", "user_data": "}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:52.898499 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] validate_networks() for [('1b9d3b9d-33b4-42c3-8ca9-050f1e19ea7c', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:03:53.285598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:03:53.286019 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:03:53.286484 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:03:53.286917 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:03:53.287354 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:03:53.296086 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:53.296594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:53.297022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:53.297738 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:53.298182 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:53.298609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:53.315922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Getting quotas for project c11dfd80b6c544f6b87a58d5a25c5649. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:03:53.320688 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Getting quotas for user 77b8847d10744ec98e0ed7a3f1e991ed and project c11dfd80b6c544f6b87a58d5a25c5649. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:03:53.333011 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:03:53.335796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:03:53.389450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-47b53fd2-6205-4207-822e-774464aa79dc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.606434 Aug 10 17:03:53.390306 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 564/1110] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 17:03:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:03:53.401363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d3d7bd7-bbc8-4cf4-805f-0bfeb29e57e1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:53.402852 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d3d7bd7-bbc8-4cf4-805f-0bfeb29e57e1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:53.474652 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d3d7bd7-bbc8-4cf4-805f-0bfeb29e57e1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:53.481291 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d3d7bd7-bbc8-4cf4-805f-0bfeb29e57e1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1237 microversion: 2.1 time: 0.083931 Aug 10 17:03:53.481852 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 547/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:53 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:03:54.504252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-02255d49-5d9d-4295-ac22-a5622d7eb4c9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:54.504964 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-02255d49-5d9d-4295-ac22-a5622d7eb4c9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:54.511354 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02255d49-5d9d-4295-ac22-a5622d7eb4c9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:54.512044 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02255d49-5d9d-4295-ac22-a5622d7eb4c9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:54.512779 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02255d49-5d9d-4295-ac22-a5622d7eb4c9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:54.513522 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02255d49-5d9d-4295-ac22-a5622d7eb4c9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:54.514024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02255d49-5d9d-4295-ac22-a5622d7eb4c9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:54.514646 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02255d49-5d9d-4295-ac22-a5622d7eb4c9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:54.602346 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-02255d49-5d9d-4295-ac22-a5622d7eb4c9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:54.611331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-02255d49-5d9d-4295-ac22-a5622d7eb4c9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1307 microversion: 2.1 time: 0.112083 Aug 10 17:03:54.612087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 565/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:54 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:55.633592 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8fb3bd07-7d79-4bbe-af1b-fa00fc2d071f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:55.634202 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8fb3bd07-7d79-4bbe-af1b-fa00fc2d071f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:55.641123 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb3bd07-7d79-4bbe-af1b-fa00fc2d071f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:55.641616 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb3bd07-7d79-4bbe-af1b-fa00fc2d071f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:55.642070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb3bd07-7d79-4bbe-af1b-fa00fc2d071f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:55.642757 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb3bd07-7d79-4bbe-af1b-fa00fc2d071f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:55.643210 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb3bd07-7d79-4bbe-af1b-fa00fc2d071f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:55.643812 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fb3bd07-7d79-4bbe-af1b-fa00fc2d071f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:55.780681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8fb3bd07-7d79-4bbe-af1b-fa00fc2d071f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:55.789455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8fb3bd07-7d79-4bbe-af1b-fa00fc2d071f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1362 microversion: 2.1 time: 0.160370 Aug 10 17:03:55.790037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 548/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:55 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:03:55.885682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-0fd6d809-ac65-4563-871e-e65e16d95f90 req-a8555c89-824d-400c-96c5-5f3a3f152869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8b8fdf-5e32-44fc-9b45-6e7a634d909c", "tag": "a2912711-1309-49e8-8095-321960439307"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:03:55.896309 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0fd6d809-ac65-4563-871e-e65e16d95f90 req-a8555c89-824d-400c-96c5-5f3a3f152869 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:55.896888 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0fd6d809-ac65-4563-871e-e65e16d95f90 req-a8555c89-824d-400c-96c5-5f3a3f152869 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:55.897399 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0fd6d809-ac65-4563-871e-e65e16d95f90 req-a8555c89-824d-400c-96c5-5f3a3f152869 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:55.908329 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-0fd6d809-ac65-4563-871e-e65e16d95f90 req-a8555c89-824d-400c-96c5-5f3a3f152869 service nova] Creating event network-changed:a2912711-1309-49e8-8095-321960439307 for instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c on hv-cinder-83602 Aug 10 17:03:55.913707 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-0fd6d809-ac65-4563-871e-e65e16d95f90 req-a8555c89-824d-400c-96c5-5f3a3f152869 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031893 Aug 10 17:03:55.914288 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 566/1114] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:03:56.811055 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ae054c0-9a99-4508-816a-86ea82023438 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:56.811670 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ae054c0-9a99-4508-816a-86ea82023438 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:56.818645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ae054c0-9a99-4508-816a-86ea82023438 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:56.819124 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ae054c0-9a99-4508-816a-86ea82023438 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:56.819557 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ae054c0-9a99-4508-816a-86ea82023438 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:56.820272 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ae054c0-9a99-4508-816a-86ea82023438 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:56.820725 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ae054c0-9a99-4508-816a-86ea82023438 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:56.821153 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ae054c0-9a99-4508-816a-86ea82023438 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:56.965581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6ae054c0-9a99-4508-816a-86ea82023438 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:56.973422 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ae054c0-9a99-4508-816a-86ea82023438 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1362 microversion: 2.1 time: 0.166478 Aug 10 17:03:56.974000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 549/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:56 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:57.995378 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0b202e29-d3a7-42d1-b453-1a2c6ab729fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:57.996066 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0b202e29-d3a7-42d1-b453-1a2c6ab729fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:58.002547 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b202e29-d3a7-42d1-b453-1a2c6ab729fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:58.003040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b202e29-d3a7-42d1-b453-1a2c6ab729fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:58.003470 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b202e29-d3a7-42d1-b453-1a2c6ab729fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:58.004180 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b202e29-d3a7-42d1-b453-1a2c6ab729fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:58.004633 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b202e29-d3a7-42d1-b453-1a2c6ab729fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:58.005543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b202e29-d3a7-42d1-b453-1a2c6ab729fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:58.145852 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0b202e29-d3a7-42d1-b453-1a2c6ab729fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:58.154272 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0b202e29-d3a7-42d1-b453-1a2c6ab729fc tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1362 microversion: 2.1 time: 0.163809 Aug 10 17:03:58.154841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 567/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:57 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:03:59.177052 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8af24d9f-fcf3-4589-b0e3-a741863c253e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:03:59.177671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8af24d9f-fcf3-4589-b0e3-a741863c253e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:03:59.185385 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af24d9f-fcf3-4589-b0e3-a741863c253e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:59.186685 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af24d9f-fcf3-4589-b0e3-a741863c253e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:59.187141 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af24d9f-fcf3-4589-b0e3-a741863c253e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:59.187850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af24d9f-fcf3-4589-b0e3-a741863c253e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:03:59.188339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af24d9f-fcf3-4589-b0e3-a741863c253e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:03:59.188772 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af24d9f-fcf3-4589-b0e3-a741863c253e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:03:59.330633 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8af24d9f-fcf3-4589-b0e3-a741863c253e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:03:59.343389 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8af24d9f-fcf3-4589-b0e3-a741863c253e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1362 microversion: 2.1 time: 0.171553 Aug 10 17:03:59.343961 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 550/1117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:03:59 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:00.364770 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-00d777cf-b5e9-4dbe-86d2-c4e0715fddf9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:00.365399 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-00d777cf-b5e9-4dbe-86d2-c4e0715fddf9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:00.371669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00d777cf-b5e9-4dbe-86d2-c4e0715fddf9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:00.372171 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00d777cf-b5e9-4dbe-86d2-c4e0715fddf9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:00.372608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00d777cf-b5e9-4dbe-86d2-c4e0715fddf9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:00.373297 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00d777cf-b5e9-4dbe-86d2-c4e0715fddf9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:00.373743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00d777cf-b5e9-4dbe-86d2-c4e0715fddf9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:00.374158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00d777cf-b5e9-4dbe-86d2-c4e0715fddf9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:00.508125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-00d777cf-b5e9-4dbe-86d2-c4e0715fddf9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:00.516253 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-00d777cf-b5e9-4dbe-86d2-c4e0715fddf9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1362 microversion: 2.1 time: 0.155233 Aug 10 17:04:00.517027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 568/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:00 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:01.537523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-adfea318-b9e1-441a-a225-0cd921119a4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:01.538053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-adfea318-b9e1-441a-a225-0cd921119a4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:01.544469 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfea318-b9e1-441a-a225-0cd921119a4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:01.544953 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfea318-b9e1-441a-a225-0cd921119a4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:01.545390 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfea318-b9e1-441a-a225-0cd921119a4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:01.546077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfea318-b9e1-441a-a225-0cd921119a4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:01.546531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfea318-b9e1-441a-a225-0cd921119a4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:01.546956 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfea318-b9e1-441a-a225-0cd921119a4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:01.678827 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-adfea318-b9e1-441a-a225-0cd921119a4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:01.686185 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-adfea318-b9e1-441a-a225-0cd921119a4e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1362 microversion: 2.1 time: 0.153147 Aug 10 17:04:01.687556 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 551/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:01 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:02.517145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-78a0760e-4adf-4961-bdff-fca647ef47cb req-1d706530-d238-4dd6-8aa7-d5e8c2c7bbba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8b8fdf-5e32-44fc-9b45-6e7a634d909c", "name": "network-vif-plugged", "status": "completed", "tag": "a2912711-1309-49e8-8095-321960439307"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:02.527663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-78a0760e-4adf-4961-bdff-fca647ef47cb req-1d706530-d238-4dd6-8aa7-d5e8c2c7bbba service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:02.528246 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-78a0760e-4adf-4961-bdff-fca647ef47cb req-1d706530-d238-4dd6-8aa7-d5e8c2c7bbba service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:02.528779 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-78a0760e-4adf-4961-bdff-fca647ef47cb req-1d706530-d238-4dd6-8aa7-d5e8c2c7bbba service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:02.540746 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-78a0760e-4adf-4961-bdff-fca647ef47cb req-1d706530-d238-4dd6-8aa7-d5e8c2c7bbba service nova] Creating event network-vif-plugged:a2912711-1309-49e8-8095-321960439307 for instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c on hv-cinder-83602 Aug 10 17:04:02.545953 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-78a0760e-4adf-4961-bdff-fca647ef47cb req-1d706530-d238-4dd6-8aa7-d5e8c2c7bbba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033267 Aug 10 17:04:02.547263 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 569/1120] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:04:02.707285 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0cd6cfeb-1e1e-4f89-850d-1fc87402286e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:02.708099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0cd6cfeb-1e1e-4f89-850d-1fc87402286e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:02.714685 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cd6cfeb-1e1e-4f89-850d-1fc87402286e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:02.715180 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cd6cfeb-1e1e-4f89-850d-1fc87402286e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:02.715620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cd6cfeb-1e1e-4f89-850d-1fc87402286e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:02.716363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cd6cfeb-1e1e-4f89-850d-1fc87402286e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:02.716825 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cd6cfeb-1e1e-4f89-850d-1fc87402286e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:02.717606 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0cd6cfeb-1e1e-4f89-850d-1fc87402286e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:02.853255 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0cd6cfeb-1e1e-4f89-850d-1fc87402286e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:02.860792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0cd6cfeb-1e1e-4f89-850d-1fc87402286e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1362 microversion: 2.1 time: 0.157333 Aug 10 17:04:02.861363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 552/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:02 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:03.879567 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:03.880419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:03.885307 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ac55efd8-d3c9-49f6-849f-945fdd294333 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:03.886012 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ac55efd8-d3c9-49f6-849f-945fdd294333 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:03.893038 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ac55efd8-d3c9-49f6-849f-945fdd294333 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:03.893473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ac55efd8-d3c9-49f6-849f-945fdd294333 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:03.893908 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ac55efd8-d3c9-49f6-849f-945fdd294333 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:03.895146 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ac55efd8-d3c9-49f6-849f-945fdd294333 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:03.895575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ac55efd8-d3c9-49f6-849f-945fdd294333 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:03.895995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ac55efd8-d3c9-49f6-849f-945fdd294333 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:04.058266 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ac55efd8-d3c9-49f6-849f-945fdd294333 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:04.067079 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ac55efd8-d3c9-49f6-849f-945fdd294333 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1362 microversion: 2.1 time: 0.188450 Aug 10 17:04:04.067648 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 570/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:03 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:05.087970 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-140bc357-3c17-41f7-9b82-873640ba879d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:05.088835 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-140bc357-3c17-41f7-9b82-873640ba879d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:05.090800 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:05.096661 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140bc357-3c17-41f7-9b82-873640ba879d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:05.097155 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140bc357-3c17-41f7-9b82-873640ba879d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:05.097742 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140bc357-3c17-41f7-9b82-873640ba879d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:05.098458 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140bc357-3c17-41f7-9b82-873640ba879d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:05.099045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140bc357-3c17-41f7-9b82-873640ba879d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:05.099476 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140bc357-3c17-41f7-9b82-873640ba879d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:05.234986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-140bc357-3c17-41f7-9b82-873640ba879d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:05.242591 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-140bc357-3c17-41f7-9b82-873640ba879d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1549 microversion: 2.1 time: 0.158718 Aug 10 17:04:05.243155 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 553/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:05 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:05.264406 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-aa9ae272-8a6b-451e-b814-12d4978048d9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:05.264959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-aa9ae272-8a6b-451e-b814-12d4978048d9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:05.271910 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa9ae272-8a6b-451e-b814-12d4978048d9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:05.272483 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa9ae272-8a6b-451e-b814-12d4978048d9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:05.272844 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa9ae272-8a6b-451e-b814-12d4978048d9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:05.273552 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa9ae272-8a6b-451e-b814-12d4978048d9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:05.274008 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa9ae272-8a6b-451e-b814-12d4978048d9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:05.274496 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa9ae272-8a6b-451e-b814-12d4978048d9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:05.376883 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-aa9ae272-8a6b-451e-b814-12d4978048d9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117271 Aug 10 17:04:05.377588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 571/1124] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 10 17:04:05 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:04:06.355909 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ea0bfaff-20b6-4e10-b2bc-67c40cb99137 req-e00b8bfc-a24b-4fbf-a376-c237f8e26b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8b8fdf-5e32-44fc-9b45-6e7a634d909c", "tag": "a2912711-1309-49e8-8095-321960439307"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:06.366999 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ea0bfaff-20b6-4e10-b2bc-67c40cb99137 req-e00b8bfc-a24b-4fbf-a376-c237f8e26b94 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:06.367489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ea0bfaff-20b6-4e10-b2bc-67c40cb99137 req-e00b8bfc-a24b-4fbf-a376-c237f8e26b94 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:06.367927 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ea0bfaff-20b6-4e10-b2bc-67c40cb99137 req-e00b8bfc-a24b-4fbf-a376-c237f8e26b94 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:06.379599 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ea0bfaff-20b6-4e10-b2bc-67c40cb99137 req-e00b8bfc-a24b-4fbf-a376-c237f8e26b94 service nova] Creating event network-changed:a2912711-1309-49e8-8095-321960439307 for instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c on hv-cinder-83602 Aug 10 17:04:06.385906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ea0bfaff-20b6-4e10-b2bc-67c40cb99137 req-e00b8bfc-a24b-4fbf-a376-c237f8e26b94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034192 Aug 10 17:04:06.386505 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 554/1125] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:04:22.385777 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:22.386441 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=65 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:22.390222 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-44edf6f9-fe64-497a-b954-1485efd84731 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:22.390701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-44edf6f9-fe64-497a-b954-1485efd84731 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:22.397408 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44edf6f9-fe64-497a-b954-1485efd84731 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:22.397875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44edf6f9-fe64-497a-b954-1485efd84731 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:22.398318 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44edf6f9-fe64-497a-b954-1485efd84731 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:22.399024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44edf6f9-fe64-497a-b954-1485efd84731 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:22.400029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44edf6f9-fe64-497a-b954-1485efd84731 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:22.400488 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44edf6f9-fe64-497a-b954-1485efd84731 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:22.424912 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-44edf6f9-fe64-497a-b954-1485efd84731 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/ips" status: 200 len: 150 microversion: 2.1 time: 0.040645 Aug 10 17:04:22.425476 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 572/1126] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 10 17:04:22 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:04:23.761539 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:23.762387 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=89 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:23.766806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a36669d5-8184-4356-bda2-1aca71756e3e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb42af1d-ded7-46af-abe7-3ef8a3f49b59"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:23.769242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a36669d5-8184-4356-bda2-1aca71756e3e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:23.777938 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a36669d5-8184-4356-bda2-1aca71756e3e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:23.778436 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a36669d5-8184-4356-bda2-1aca71756e3e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:23.778876 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a36669d5-8184-4356-bda2-1aca71756e3e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:23.779583 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a36669d5-8184-4356-bda2-1aca71756e3e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:23.780042 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a36669d5-8184-4356-bda2-1aca71756e3e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:23.780506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a36669d5-8184-4356-bda2-1aca71756e3e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:24.058757 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a36669d5-8184-4356-bda2-1aca71756e3e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298622 Aug 10 17:04:24.059374 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 555/1127] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 17:04:23 2022] POST /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:04:32.630338 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb42af1d-ded7-46af-abe7-3ef8a3f49b59"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:32.632716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:32.635723 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:32.636389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=4 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:32.642343 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:32.642820 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:32.643253 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:32.643939 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:32.644414 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:32.644836 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:32.722531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Invalid volume: volume bb42af1d-ded7-46af-abe7-3ef8a3f49b59 is already attached to instances: 7432bd1c-aa00-4a08-95e9-63b9da22967f Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: POST /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments HTTP/1.1 Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 74 Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:04:32.724282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {"volumeAttachment": {"volumeId": "bb42af1d-ded7-46af-abe7-3ef8a3f49b59"}} Aug 10 17:04:32.725984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Invalid volume: volume bb42af1d-ded7-46af-abe7-3ef8a3f49b59 is already attached to instances: 7432bd1c-aa00-4a08-95e9-63b9da22967f Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'server_id': '7432bd1c-aa00-4a08-95e9-63b9da22967f', 'body': {'volumeAttachment': {'volumeId': 'bb42af1d-ded7-46af-abe7-3ef8a3f49b59'}}} Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bb42af1d-ded7-46af-abe7-3ef8a3f49b59 is already attached to instances: 7432bd1c-aa00-4a08-95e9-63b9da22967f Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:04:32.726955 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bb42af1d-ded7-46af-abe7-3ef8a3f49b59 is already attached to instances: 7432bd1c-aa00-4a08-95e9-63b9da22967f Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:04:32.728462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:04:32.730205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:04:32.730205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:04:32.730205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:04:32.730205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bb42af1d-ded7-46af-abe7-3ef8a3f49b59 is already attached to instances: 7432bd1c-aa00-4a08-95e9-63b9da22967f Aug 10 17:04:32.730205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:04:32.730205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 400 to user: Invalid volume: volume bb42af1d-ded7-46af-abe7-3ef8a3f49b59 is already attached to instances: 7432bd1c-aa00-4a08-95e9-63b9da22967f {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:04:32.730205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-241b26e8-5788-4fac-bf31-a62e46909e28 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099370 Aug 10 17:04:32.730205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 573/1128] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 17:04:32 2022] POST /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:04:32.789900 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e12f0077-666c-47bb-a091-f8efba5140fe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:32.790512 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e12f0077-666c-47bb-a091-f8efba5140fe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:32.796639 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e12f0077-666c-47bb-a091-f8efba5140fe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:32.797130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e12f0077-666c-47bb-a091-f8efba5140fe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:32.797568 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e12f0077-666c-47bb-a091-f8efba5140fe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:32.798262 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e12f0077-666c-47bb-a091-f8efba5140fe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:32.798721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e12f0077-666c-47bb-a091-f8efba5140fe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:32.799151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e12f0077-666c-47bb-a091-f8efba5140fe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:32.877060 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-e12f0077-666c-47bb-a091-f8efba5140fe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lazy-loading 'services' on Instance uuid 7432bd1c-aa00-4a08-95e9-63b9da22967f {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:04:32.950337 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e12f0077-666c-47bb-a091-f8efba5140fe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments/bb42af1d-ded7-46af-abe7-3ef8a3f49b59" status: 202 len: 0 microversion: 2.1 time: 0.165060 Aug 10 17:04:32.950926 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 556/1129] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 17:04:32 2022] DELETE /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments/bb42af1d-ded7-46af-abe7-3ef8a3f49b59 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:04:32.960588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-af3b7043-c9e5-485e-977b-05418cb831a4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:32.962784 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-af3b7043-c9e5-485e-977b-05418cb831a4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:32.969063 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af3b7043-c9e5-485e-977b-05418cb831a4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:32.969632 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af3b7043-c9e5-485e-977b-05418cb831a4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:32.970099 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af3b7043-c9e5-485e-977b-05418cb831a4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:32.971557 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af3b7043-c9e5-485e-977b-05418cb831a4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:32.972013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af3b7043-c9e5-485e-977b-05418cb831a4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:32.972792 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af3b7043-c9e5-485e-977b-05418cb831a4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:33.004485 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-af3b7043-c9e5-485e-977b-05418cb831a4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049130 Aug 10 17:04:33.005031 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 574/1130] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:04:32 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:04:34.017950 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5733da99-46b1-4340-bf28-0fbf94cf5230 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:34.020636 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5733da99-46b1-4340-bf28-0fbf94cf5230 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:34.027488 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5733da99-46b1-4340-bf28-0fbf94cf5230 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:34.027976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5733da99-46b1-4340-bf28-0fbf94cf5230 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:34.028438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5733da99-46b1-4340-bf28-0fbf94cf5230 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:34.029451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5733da99-46b1-4340-bf28-0fbf94cf5230 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:34.029633 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5733da99-46b1-4340-bf28-0fbf94cf5230 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:34.030050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5733da99-46b1-4340-bf28-0fbf94cf5230 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:34.059888 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5733da99-46b1-4340-bf28-0fbf94cf5230 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046738 Aug 10 17:04:34.060629 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 557/1131] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:04:34 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:04:35.071967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-542fa548-732f-4a07-8e00-2665ef32c08e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:35.074119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-542fa548-732f-4a07-8e00-2665ef32c08e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:35.080429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-542fa548-732f-4a07-8e00-2665ef32c08e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:35.080907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-542fa548-732f-4a07-8e00-2665ef32c08e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:35.081339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-542fa548-732f-4a07-8e00-2665ef32c08e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:35.082022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-542fa548-732f-4a07-8e00-2665ef32c08e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:35.082469 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-542fa548-732f-4a07-8e00-2665ef32c08e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:35.082889 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-542fa548-732f-4a07-8e00-2665ef32c08e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:35.112582 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-542fa548-732f-4a07-8e00-2665ef32c08e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044546 Aug 10 17:04:35.113131 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 575/1132] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:04:35 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:04:35.180340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eb761278-7758-4d9c-8cbf-7716f1355599 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:35.180340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eb761278-7758-4d9c-8cbf-7716f1355599 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:35.182338 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb761278-7758-4d9c-8cbf-7716f1355599 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:35.182818 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb761278-7758-4d9c-8cbf-7716f1355599 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:35.183252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb761278-7758-4d9c-8cbf-7716f1355599 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:35.183966 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb761278-7758-4d9c-8cbf-7716f1355599 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:35.184444 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb761278-7758-4d9c-8cbf-7716f1355599 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:35.184866 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb761278-7758-4d9c-8cbf-7716f1355599 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:35.208819 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eb761278-7758-4d9c-8cbf-7716f1355599 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:04:35.280412 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eb761278-7758-4d9c-8cbf-7716f1355599 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 204 len: 0 microversion: 2.1 time: 0.109018 Aug 10 17:04:35.283073 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 558/1133] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:04:35 2022] DELETE /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:04:35.291348 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a2d3edaa-77c4-4162-9679-c72cb52ca3ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:35.291952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a2d3edaa-77c4-4162-9679-c72cb52ca3ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:35.297772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2d3edaa-77c4-4162-9679-c72cb52ca3ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:35.298246 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2d3edaa-77c4-4162-9679-c72cb52ca3ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:35.298670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2d3edaa-77c4-4162-9679-c72cb52ca3ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:35.299345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2d3edaa-77c4-4162-9679-c72cb52ca3ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:35.299786 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2d3edaa-77c4-4162-9679-c72cb52ca3ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:35.300234 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2d3edaa-77c4-4162-9679-c72cb52ca3ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:35.432077 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a2d3edaa-77c4-4162-9679-c72cb52ca3ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:35.439731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a2d3edaa-77c4-4162-9679-c72cb52ca3ed tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1682 microversion: 2.1 time: 0.154159 Aug 10 17:04:35.440352 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 576/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:35 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:36.462083 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b865173-02a8-4fd6-b91d-a9e929b1237c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:36.462694 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b865173-02a8-4fd6-b91d-a9e929b1237c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:36.469572 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b865173-02a8-4fd6-b91d-a9e929b1237c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:36.470054 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b865173-02a8-4fd6-b91d-a9e929b1237c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:36.470489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b865173-02a8-4fd6-b91d-a9e929b1237c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:36.471184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b865173-02a8-4fd6-b91d-a9e929b1237c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:36.471636 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b865173-02a8-4fd6-b91d-a9e929b1237c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:36.472060 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b865173-02a8-4fd6-b91d-a9e929b1237c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:36.602132 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7b865173-02a8-4fd6-b91d-a9e929b1237c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:36.610022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b865173-02a8-4fd6-b91d-a9e929b1237c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1682 microversion: 2.1 time: 0.152529 Aug 10 17:04:36.610586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 559/1135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:36 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:04:37.632454 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f36a217d-0340-41d0-9202-c602af6298b3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:37.632996 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f36a217d-0340-41d0-9202-c602af6298b3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:37.640383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f36a217d-0340-41d0-9202-c602af6298b3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:37.640865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f36a217d-0340-41d0-9202-c602af6298b3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:37.641297 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f36a217d-0340-41d0-9202-c602af6298b3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:37.641975 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f36a217d-0340-41d0-9202-c602af6298b3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:37.642419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f36a217d-0340-41d0-9202-c602af6298b3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:37.643163 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f36a217d-0340-41d0-9202-c602af6298b3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:37.775325 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f36a217d-0340-41d0-9202-c602af6298b3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:37.783007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f36a217d-0340-41d0-9202-c602af6298b3 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1682 microversion: 2.1 time: 0.154909 Aug 10 17:04:37.783666 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 577/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:37 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:38.805506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-314c9200-0032-4b5e-9390-7f436a4a0bf8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:38.806753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-314c9200-0032-4b5e-9390-7f436a4a0bf8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:38.813088 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-314c9200-0032-4b5e-9390-7f436a4a0bf8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:38.813585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-314c9200-0032-4b5e-9390-7f436a4a0bf8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:38.814003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-314c9200-0032-4b5e-9390-7f436a4a0bf8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:38.814696 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-314c9200-0032-4b5e-9390-7f436a4a0bf8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:38.815147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-314c9200-0032-4b5e-9390-7f436a4a0bf8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:38.815572 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-314c9200-0032-4b5e-9390-7f436a4a0bf8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:38.882303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-314c9200-0032-4b5e-9390-7f436a4a0bf8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:38.890031 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-314c9200-0032-4b5e-9390-7f436a4a0bf8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 200 len: 1614 microversion: 2.1 time: 0.088350 Aug 10 17:04:38.890885 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 560/1137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:38 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 1614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:39.283943 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-7686f573-ffe0-4662-b548-dba408b1203c req-815ec146-1f5d-4967-ac1e-76a21b9810d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7432bd1c-aa00-4a08-95e9-63b9da22967f", "name": "network-vif-deleted", "tag": "42838665-21f4-4962-979d-dee2bed7cf1f"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:39.295690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-7686f573-ffe0-4662-b548-dba408b1203c req-815ec146-1f5d-4967-ac1e-76a21b9810d2 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:39.296183 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-7686f573-ffe0-4662-b548-dba408b1203c req-815ec146-1f5d-4967-ac1e-76a21b9810d2 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:39.296612 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-7686f573-ffe0-4662-b548-dba408b1203c req-815ec146-1f5d-4967-ac1e-76a21b9810d2 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:39.324509 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-7686f573-ffe0-4662-b548-dba408b1203c req-815ec146-1f5d-4967-ac1e-76a21b9810d2 service nova] Creating event network-vif-deleted:42838665-21f4-4962-979d-dee2bed7cf1f for instance 7432bd1c-aa00-4a08-95e9-63b9da22967f on hv-cinder-83602 Aug 10 17:04:39.330567 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-7686f573-ffe0-4662-b548-dba408b1203c req-815ec146-1f5d-4967-ac1e-76a21b9810d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050277 Aug 10 17:04:39.331848 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 578/1138] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:04:39.917165 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:39.918977 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:39.927939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:39.928868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:39.929599 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:39.930671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:39.931149 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:39.931779 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:39.946572 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f HTTP/1.1 Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:04:39.948279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:04:39.949717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '7432bd1c-aa00-4a08-95e9-63b9da22967f'} Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:04:39.950552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:04:39.953545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:04:39.954730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:04:39.954730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-50413155-26d9-4f86-8383-a178d659d474 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 404 len: 111 microversion: 2.1 time: 0.043113 Aug 10 17:04:39.954730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 561/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:39 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:04:39.964450 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-65b78548-d608-4494-bcea-7b1d58379afc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '.version_select at 0x7f5b0cba0790>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:39.987077 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-65b78548-d608-4494-bcea-7b1d58379afc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011495431" status: 202 len: 0 microversion: 2.1 time: 0.031595 Aug 10 17:04:39.987608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 579/1140] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Aug 10 17:04:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011495431 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:04:40.605262 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6082083a-141d-4685-acca-5f4f129945e6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: .version_select at 0x7f5b0848a550>, body: {"keypair": {"name": "tempest-keypair-2101812522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCA45zU4j4+An7PlNG/m976Y71TSQDo6ybOnRlbH25VuvH9mMj5oFdqh6ZVio9zlGsWS30qAsD6/2ZBxzT6zIMXPli8thcZ3JnENpln5+D7QvRpDViusUbwqjm1RyK9blw=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:40.621037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-6082083a-141d-4685-acca-5f4f129945e6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:04:40.625229 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-6082083a-141d-4685-acca-5f4f129945e6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for user 7a701149974b45db9f782bc5a232aabe and project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:04:40.648288 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6082083a-141d-4685-acca-5f4f129945e6 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047083 Aug 10 17:04:40.648864 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 562/1141] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 10 17:04:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:04:41.858962 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-233389862", "imageRef": "de06ecaf-6364-49ee-8c15-a356743569a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbfebec6-8639-47f9-80f8-59f6b2be1e54"}], "security_groups": [{"name": "tempest-securitygroup--1808325026"}], "key_name": "tempest-keypair-2101812522", "user_data": "}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:41.959376 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] validate_networks() for [('dbfebec6-8639-47f9-80f8-59f6b2be1e54', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:04:42.320237 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:04:42.320669 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:04:42.321146 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:04:42.321680 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:04:42.322100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:04:42.330903 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:42.331403 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:42.331844 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:42.332615 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:42.333072 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:42.333500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:42.350238 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:04:42.354125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Getting quotas for user 7a701149974b45db9f782bc5a232aabe and project a5cd009fd06248eebfe0c84b055ef3e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:04:42.365420 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:04:42.367734 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de06ecaf-6364-49ee-8c15-a356743569a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:04:42.414349 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4d682914-666c-4411-a040-809aa42000d8 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.560099 Aug 10 17:04:42.414991 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 580/1142] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 17:04:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:04:42.426210 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a32ab822-39d0-49cb-b7b4-4d88ae3f778e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:42.426952 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a32ab822-39d0-49cb-b7b4-4d88ae3f778e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:42.485290 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a32ab822-39d0-49cb-b7b4-4d88ae3f778e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:42.491925 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a32ab822-39d0-49cb-b7b4-4d88ae3f778e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1241 microversion: 2.1 time: 0.069591 Aug 10 17:04:42.492522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 563/1143] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:42 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:43.514301 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d328b116-c2a0-44f7-a0d2-f876b93f492a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:43.514839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d328b116-c2a0-44f7-a0d2-f876b93f492a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:43.521064 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d328b116-c2a0-44f7-a0d2-f876b93f492a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:43.521537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d328b116-c2a0-44f7-a0d2-f876b93f492a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:43.521965 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d328b116-c2a0-44f7-a0d2-f876b93f492a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:43.522639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d328b116-c2a0-44f7-a0d2-f876b93f492a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:43.523083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d328b116-c2a0-44f7-a0d2-f876b93f492a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:43.523498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d328b116-c2a0-44f7-a0d2-f876b93f492a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:43.588552 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d328b116-c2a0-44f7-a0d2-f876b93f492a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:43.595983 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d328b116-c2a0-44f7-a0d2-f876b93f492a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1245 microversion: 2.1 time: 0.086877 Aug 10 17:04:43.596575 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 581/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:43 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:43.738310 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-11deddb6-ce37-4850-ab04-63b9fe50a892 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:43.738867 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-11deddb6-ce37-4850-ab04-63b9fe50a892 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:43.745670 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11deddb6-ce37-4850-ab04-63b9fe50a892 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:43.746155 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11deddb6-ce37-4850-ab04-63b9fe50a892 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:43.746590 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11deddb6-ce37-4850-ab04-63b9fe50a892 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:43.747287 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11deddb6-ce37-4850-ab04-63b9fe50a892 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:43.747739 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11deddb6-ce37-4850-ab04-63b9fe50a892 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:43.748184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11deddb6-ce37-4850-ab04-63b9fe50a892 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:43.776057 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-11deddb6-ce37-4850-ab04-63b9fe50a892 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/ips" status: 200 len: 152 microversion: 2.20 time: 0.041510 Aug 10 17:04:43.776632 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 564/1145] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Aug 10 17:04:43 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:04:44.615780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a57d6a3c-7f64-4dd5-aa5e-396322058ac9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:44.616423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a57d6a3c-7f64-4dd5-aa5e-396322058ac9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:44.622824 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a57d6a3c-7f64-4dd5-aa5e-396322058ac9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:44.623303 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a57d6a3c-7f64-4dd5-aa5e-396322058ac9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:44.623737 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a57d6a3c-7f64-4dd5-aa5e-396322058ac9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:44.624445 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a57d6a3c-7f64-4dd5-aa5e-396322058ac9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:44.624898 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a57d6a3c-7f64-4dd5-aa5e-396322058ac9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:44.625319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a57d6a3c-7f64-4dd5-aa5e-396322058ac9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:44.839383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a57d6a3c-7f64-4dd5-aa5e-396322058ac9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:44.846751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a57d6a3c-7f64-4dd5-aa5e-396322058ac9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1245 microversion: 2.1 time: 0.234867 Aug 10 17:04:44.847304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 582/1146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:44 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1245 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:45.867326 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6304691a-404b-4846-ab63-c814f8f3e509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:45.867953 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6304691a-404b-4846-ab63-c814f8f3e509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:45.874431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6304691a-404b-4846-ab63-c814f8f3e509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:45.874915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6304691a-404b-4846-ab63-c814f8f3e509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:45.875381 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6304691a-404b-4846-ab63-c814f8f3e509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:45.876079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6304691a-404b-4846-ab63-c814f8f3e509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:45.876564 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6304691a-404b-4846-ab63-c814f8f3e509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:45.876996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6304691a-404b-4846-ab63-c814f8f3e509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:45.995346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6304691a-404b-4846-ab63-c814f8f3e509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:46.002792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6304691a-404b-4846-ab63-c814f8f3e509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1293 microversion: 2.1 time: 0.139360 Aug 10 17:04:46.003451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 565/1147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:45 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1293 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:47.025042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bcf974f5-d0bd-4d36-8e70-d18affbcbfb4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:47.028517 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bcf974f5-d0bd-4d36-8e70-d18affbcbfb4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:47.034969 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bcf974f5-d0bd-4d36-8e70-d18affbcbfb4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:47.035590 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bcf974f5-d0bd-4d36-8e70-d18affbcbfb4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:47.036024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bcf974f5-d0bd-4d36-8e70-d18affbcbfb4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:47.036832 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bcf974f5-d0bd-4d36-8e70-d18affbcbfb4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:47.037280 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bcf974f5-d0bd-4d36-8e70-d18affbcbfb4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:47.037698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bcf974f5-d0bd-4d36-8e70-d18affbcbfb4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:47.251419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bcf974f5-d0bd-4d36-8e70-d18affbcbfb4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:47.258820 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bcf974f5-d0bd-4d36-8e70-d18affbcbfb4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1367 microversion: 2.1 time: 0.237638 Aug 10 17:04:47.259480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 583/1148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:47 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:47.543922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-58bf5dc7-981c-4191-8b17-757a2b418e3d req-c661376a-f2f0-428f-b1d5-d49c0d7f7657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fed6781-3a30-42e6-9787-79f2f12b53de", "tag": "d7efa356-be18-4b34-8e2f-1021ac1dcb84"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:47.554137 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-58bf5dc7-981c-4191-8b17-757a2b418e3d req-c661376a-f2f0-428f-b1d5-d49c0d7f7657 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:47.554478 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-58bf5dc7-981c-4191-8b17-757a2b418e3d req-c661376a-f2f0-428f-b1d5-d49c0d7f7657 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:47.554917 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-58bf5dc7-981c-4191-8b17-757a2b418e3d req-c661376a-f2f0-428f-b1d5-d49c0d7f7657 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:47.566678 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-58bf5dc7-981c-4191-8b17-757a2b418e3d req-c661376a-f2f0-428f-b1d5-d49c0d7f7657 service nova] Creating event network-changed:d7efa356-be18-4b34-8e2f-1021ac1dcb84 for instance 0fed6781-3a30-42e6-9787-79f2f12b53de on hv-cinder-83602 Aug 10 17:04:47.579059 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-58bf5dc7-981c-4191-8b17-757a2b418e3d req-c661376a-f2f0-428f-b1d5-d49c0d7f7657 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038659 Aug 10 17:04:47.579863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 566/1149] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:04:47.874648 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a7e57503-a7e2-484e-aa14-d87ed641ae98 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:47.875292 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a7e57503-a7e2-484e-aa14-d87ed641ae98 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:47.881849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7e57503-a7e2-484e-aa14-d87ed641ae98 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:47.882394 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7e57503-a7e2-484e-aa14-d87ed641ae98 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:47.882828 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7e57503-a7e2-484e-aa14-d87ed641ae98 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:47.883517 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7e57503-a7e2-484e-aa14-d87ed641ae98 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:47.884015 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7e57503-a7e2-484e-aa14-d87ed641ae98 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:47.884461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7e57503-a7e2-484e-aa14-d87ed641ae98 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:47.909894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-a7e57503-a7e2-484e-aa14-d87ed641ae98 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lazy-loading 'flavor' on Instance uuid 55af62cb-d5be-4fef-b179-39240d0b13cb {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:04:48.091769 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a7e57503-a7e2-484e-aa14-d87ed641ae98 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "POST /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/action" status: 202 len: 0 microversion: 2.20 time: 0.221359 Aug 10 17:04:48.092827 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 584/1150] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Aug 10 17:04:47 2022] POST /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:04:48.101873 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:48.102648 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:48.110902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:48.111451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:48.112600 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:48.113309 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:48.113813 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:48.114238 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:48.242825 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:48.250718 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:48.252244 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:48.253389 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7c3ccdd8-dfc9-4c7f-949f-bdd6729a1a75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.156081 Aug 10 17:04:48.253945 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 567/1151] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:04:48 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:04:48.279851 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a1618968-c513-4072-b7fc-89fd9230b108 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:48.280577 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a1618968-c513-4072-b7fc-89fd9230b108 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:48.287655 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1618968-c513-4072-b7fc-89fd9230b108 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:48.288166 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1618968-c513-4072-b7fc-89fd9230b108 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:48.288604 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1618968-c513-4072-b7fc-89fd9230b108 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:48.289295 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1618968-c513-4072-b7fc-89fd9230b108 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:48.289744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1618968-c513-4072-b7fc-89fd9230b108 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:48.290166 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1618968-c513-4072-b7fc-89fd9230b108 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:48.313985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1f06ec17-1ddf-4c0c-93d1-15f835530641 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:48.314513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1f06ec17-1ddf-4c0c-93d1-15f835530641 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:48.320676 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f06ec17-1ddf-4c0c-93d1-15f835530641 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:48.321160 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f06ec17-1ddf-4c0c-93d1-15f835530641 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:48.321594 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f06ec17-1ddf-4c0c-93d1-15f835530641 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:48.322283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f06ec17-1ddf-4c0c-93d1-15f835530641 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:48.322730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f06ec17-1ddf-4c0c-93d1-15f835530641 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:48.323647 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f06ec17-1ddf-4c0c-93d1-15f835530641 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:48.347684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-1f06ec17-1ddf-4c0c-93d1-15f835530641 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lazy-loading 'flavor' on Instance uuid cca57c21-5ab9-42f0-ba5c-158b397c8223 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:04:48.423038 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1f06ec17-1ddf-4c0c-93d1-15f835530641 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "POST /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223/action" status: 202 len: 0 microversion: 2.1 time: 0.112862 Aug 10 17:04:48.423960 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 568/1152] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 17:04:48 2022] POST /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:04:48.432397 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c7117f8-e6ad-4422-9f85-cd59e33faee7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:48.434113 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0c7117f8-e6ad-4422-9f85-cd59e33faee7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:48.440770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c7117f8-e6ad-4422-9f85-cd59e33faee7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:48.441442 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c7117f8-e6ad-4422-9f85-cd59e33faee7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:48.441876 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c7117f8-e6ad-4422-9f85-cd59e33faee7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:48.445918 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c7117f8-e6ad-4422-9f85-cd59e33faee7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:48.446493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c7117f8-e6ad-4422-9f85-cd59e33faee7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:48.446947 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c7117f8-e6ad-4422-9f85-cd59e33faee7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:48.468527 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:48.522066 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a1618968-c513-4072-b7fc-89fd9230b108 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:48.532081 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a1618968-c513-4072-b7fc-89fd9230b108 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1367 microversion: 2.1 time: 0.256798 Aug 10 17:04:48.532905 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 585/1153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:48 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:48.594027 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c7117f8-e6ad-4422-9f85-cd59e33faee7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:48.601549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0c7117f8-e6ad-4422-9f85-cd59e33faee7 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.173551 Aug 10 17:04:48.602114 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 569/1154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:48 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:04:49.277188 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:49.277829 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:49.284838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:49.285314 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:49.285743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:49.286429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:49.286878 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:49.287299 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:49.414353 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:49.422233 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:49.423721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:49.424897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7e5ce66a-ab11-4d23-9fbd-645621234949 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.152233 Aug 10 17:04:49.425438 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 586/1155] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:04:49 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:04:49.556830 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-22f91d09-72c7-420a-a54c-058523eb777e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:49.557364 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-22f91d09-72c7-420a-a54c-058523eb777e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:49.564247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22f91d09-72c7-420a-a54c-058523eb777e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:49.564718 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22f91d09-72c7-420a-a54c-058523eb777e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:49.565150 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22f91d09-72c7-420a-a54c-058523eb777e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:49.566018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22f91d09-72c7-420a-a54c-058523eb777e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:49.566472 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22f91d09-72c7-420a-a54c-058523eb777e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:49.566896 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22f91d09-72c7-420a-a54c-058523eb777e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:49.625207 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9860edea-c949-4e20-b022-0e2b2979dc32 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:49.625814 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9860edea-c949-4e20-b022-0e2b2979dc32 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:49.631540 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9860edea-c949-4e20-b022-0e2b2979dc32 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:49.632018 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9860edea-c949-4e20-b022-0e2b2979dc32 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:49.632483 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9860edea-c949-4e20-b022-0e2b2979dc32 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:49.633166 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9860edea-c949-4e20-b022-0e2b2979dc32 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:49.633609 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9860edea-c949-4e20-b022-0e2b2979dc32 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:49.634029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9860edea-c949-4e20-b022-0e2b2979dc32 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:49.694348 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-22f91d09-72c7-420a-a54c-058523eb777e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:49.703200 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-22f91d09-72c7-420a-a54c-058523eb777e tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1367 microversion: 2.1 time: 0.150325 Aug 10 17:04:49.703794 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 570/1156] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:49 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:49.769492 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9860edea-c949-4e20-b022-0e2b2979dc32 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:49.777004 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9860edea-c949-4e20-b022-0e2b2979dc32 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.155681 Aug 10 17:04:49.778117 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 587/1157] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:49 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:04:50.449291 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:50.449929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:50.455814 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:50.456334 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:50.456839 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:50.457531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:50.457982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:50.458410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:50.724245 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0f136b1f-7638-4ef7-83bb-689abcbcc421 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:50.724915 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0f136b1f-7638-4ef7-83bb-689abcbcc421 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:50.731376 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f136b1f-7638-4ef7-83bb-689abcbcc421 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:50.731862 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f136b1f-7638-4ef7-83bb-689abcbcc421 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:50.732323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f136b1f-7638-4ef7-83bb-689abcbcc421 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:50.733016 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f136b1f-7638-4ef7-83bb-689abcbcc421 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:50.733459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f136b1f-7638-4ef7-83bb-689abcbcc421 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:50.733998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f136b1f-7638-4ef7-83bb-689abcbcc421 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:50.823692 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:50.831723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:50.833268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:50.834437 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-96de4c4d-259c-468c-bcef-f1f95a1cf52d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.389138 Aug 10 17:04:50.835257 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 571/1158] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:04:50 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:04:50.840305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d8045ef-8452-40b1-bdab-d3aa9ec07d64 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:50.841317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d8045ef-8452-40b1-bdab-d3aa9ec07d64 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:50.847200 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8045ef-8452-40b1-bdab-d3aa9ec07d64 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:50.848085 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8045ef-8452-40b1-bdab-d3aa9ec07d64 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:50.849184 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8045ef-8452-40b1-bdab-d3aa9ec07d64 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:50.850027 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8045ef-8452-40b1-bdab-d3aa9ec07d64 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:50.850494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8045ef-8452-40b1-bdab-d3aa9ec07d64 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:50.850927 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8045ef-8452-40b1-bdab-d3aa9ec07d64 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:50.873678 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0f136b1f-7638-4ef7-83bb-689abcbcc421 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:50.881061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0f136b1f-7638-4ef7-83bb-689abcbcc421 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1367 microversion: 2.1 time: 0.160853 Aug 10 17:04:50.881829 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 588/1159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:50 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:04:50.988102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d8045ef-8452-40b1-bdab-d3aa9ec07d64 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:50.995979 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d8045ef-8452-40b1-bdab-d3aa9ec07d64 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.159783 Aug 10 17:04:50.996569 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 572/1160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:50 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:51.861886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:51.862431 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:51.869429 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:51.869927 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:51.870366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:51.871088 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:51.871546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:51.871975 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:51.902180 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee4fd78b-5a38-45a7-9279-6aeb6c04dbbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:51.902884 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee4fd78b-5a38-45a7-9279-6aeb6c04dbbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:51.909356 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee4fd78b-5a38-45a7-9279-6aeb6c04dbbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:51.909838 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee4fd78b-5a38-45a7-9279-6aeb6c04dbbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:51.910280 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee4fd78b-5a38-45a7-9279-6aeb6c04dbbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:51.910966 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee4fd78b-5a38-45a7-9279-6aeb6c04dbbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:51.911413 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee4fd78b-5a38-45a7-9279-6aeb6c04dbbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:51.911835 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee4fd78b-5a38-45a7-9279-6aeb6c04dbbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:52.012308 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:52.015879 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:52.021539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:52.023030 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:52.024215 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-42175d3d-b742-4f18-85ef-1b1cdccd2631 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.166450 Aug 10 17:04:52.024773 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 589/1161] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:04:51 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:04:52.029732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-face947b-fb13-4064-a0ab-84fe7f04a227 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:52.030327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-face947b-fb13-4064-a0ab-84fe7f04a227 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:52.037393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-face947b-fb13-4064-a0ab-84fe7f04a227 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:52.037947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-face947b-fb13-4064-a0ab-84fe7f04a227 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:52.038401 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-face947b-fb13-4064-a0ab-84fe7f04a227 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:52.039263 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-face947b-fb13-4064-a0ab-84fe7f04a227 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:52.039720 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-face947b-fb13-4064-a0ab-84fe7f04a227 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:52.040340 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-face947b-fb13-4064-a0ab-84fe7f04a227 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:52.048496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ee4fd78b-5a38-45a7-9279-6aeb6c04dbbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:52.056009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ee4fd78b-5a38-45a7-9279-6aeb6c04dbbe tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1367 microversion: 2.1 time: 0.158365 Aug 10 17:04:52.056655 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 573/1162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:51 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:04:52.170242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-face947b-fb13-4064-a0ab-84fe7f04a227 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:52.177748 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-face947b-fb13-4064-a0ab-84fe7f04a227 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.151844 Aug 10 17:04:52.178303 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 590/1163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:52 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:53.047742 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:53.048303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:53.050090 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:53.055890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:53.056408 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:53.056852 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:53.057551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:53.058007 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:53.058435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:53.078620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c937c520-2a18-47aa-8910-8af25bed95b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:53.079231 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c937c520-2a18-47aa-8910-8af25bed95b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:53.081125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:53.081765 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:53.089458 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c937c520-2a18-47aa-8910-8af25bed95b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:53.090117 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c937c520-2a18-47aa-8910-8af25bed95b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:53.090619 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c937c520-2a18-47aa-8910-8af25bed95b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:53.091477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c937c520-2a18-47aa-8910-8af25bed95b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:53.091968 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c937c520-2a18-47aa-8910-8af25bed95b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:53.092727 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c937c520-2a18-47aa-8910-8af25bed95b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:53.189315 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:53.201657 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:53.203260 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:53.204710 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2222f92a-645e-458c-96bb-76192be01590 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.161081 Aug 10 17:04:53.205377 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 574/1164] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:04:53 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:04:53.210291 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c7b0e042-264f-45a8-b2aa-20e8ceb9cd88 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:53.210964 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c7b0e042-264f-45a8-b2aa-20e8ceb9cd88 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:53.216924 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b0e042-264f-45a8-b2aa-20e8ceb9cd88 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:53.217629 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b0e042-264f-45a8-b2aa-20e8ceb9cd88 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:53.218255 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b0e042-264f-45a8-b2aa-20e8ceb9cd88 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:53.219150 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b0e042-264f-45a8-b2aa-20e8ceb9cd88 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:53.219789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b0e042-264f-45a8-b2aa-20e8ceb9cd88 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:53.220447 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b0e042-264f-45a8-b2aa-20e8ceb9cd88 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:53.236397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c937c520-2a18-47aa-8910-8af25bed95b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:53.245926 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c937c520-2a18-47aa-8910-8af25bed95b5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1367 microversion: 2.1 time: 0.171237 Aug 10 17:04:53.254127 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 591/1165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:53 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:04:53.358372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c7b0e042-264f-45a8-b2aa-20e8ceb9cd88 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:53.366431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c7b0e042-264f-45a8-b2aa-20e8ceb9cd88 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.159776 Aug 10 17:04:53.367015 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 575/1166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:53 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:54.227307 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:54.228048 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:54.234388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:54.234950 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:54.235461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:54.236176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:54.236645 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:54.237071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:54.267487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f3514641-3a2c-4452-a41f-6ab62b37538a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:54.268182 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f3514641-3a2c-4452-a41f-6ab62b37538a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:54.271656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:54.275564 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3514641-3a2c-4452-a41f-6ab62b37538a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:54.276134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3514641-3a2c-4452-a41f-6ab62b37538a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:54.276666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3514641-3a2c-4452-a41f-6ab62b37538a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:54.277448 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3514641-3a2c-4452-a41f-6ab62b37538a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:54.277981 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3514641-3a2c-4452-a41f-6ab62b37538a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:54.279134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3514641-3a2c-4452-a41f-6ab62b37538a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:54.419379 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f3514641-3a2c-4452-a41f-6ab62b37538a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:54.427501 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f3514641-3a2c-4452-a41f-6ab62b37538a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1367 microversion: 2.1 time: 0.163901 Aug 10 17:04:54.428085 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 576/1167] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:54 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:04:54.432894 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ada6dda-9fa8-4b46-b9e8-9064f56133f4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:54.433506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ada6dda-9fa8-4b46-b9e8-9064f56133f4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:54.439797 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ada6dda-9fa8-4b46-b9e8-9064f56133f4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:54.440320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ada6dda-9fa8-4b46-b9e8-9064f56133f4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:54.440756 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ada6dda-9fa8-4b46-b9e8-9064f56133f4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:54.441459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ada6dda-9fa8-4b46-b9e8-9064f56133f4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:54.441909 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ada6dda-9fa8-4b46-b9e8-9064f56133f4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:54.442328 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ada6dda-9fa8-4b46-b9e8-9064f56133f4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:54.580710 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4ada6dda-9fa8-4b46-b9e8-9064f56133f4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:54.588552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ada6dda-9fa8-4b46-b9e8-9064f56133f4 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.159257 Aug 10 17:04:54.589566 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 577/1168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:54 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:54.710769 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:54.719260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:54.720811 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:54.721975 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4402be77-0ebf-4366-8e55-e891fa7a5ea1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.498579 Aug 10 17:04:54.722532 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 592/1169] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:04:54 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:04:55.360628 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-06b59a04-d425-42eb-b9aa-f484ce3d715b req-47882c07-3d9f-46d1-803c-94734f6a2763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fed6781-3a30-42e6-9787-79f2f12b53de", "name": "network-vif-plugged", "status": "completed", "tag": "d7efa356-be18-4b34-8e2f-1021ac1dcb84"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:55.370790 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-06b59a04-d425-42eb-b9aa-f484ce3d715b req-47882c07-3d9f-46d1-803c-94734f6a2763 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:55.371283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-06b59a04-d425-42eb-b9aa-f484ce3d715b req-47882c07-3d9f-46d1-803c-94734f6a2763 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:55.371718 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-06b59a04-d425-42eb-b9aa-f484ce3d715b req-47882c07-3d9f-46d1-803c-94734f6a2763 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:55.383089 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-06b59a04-d425-42eb-b9aa-f484ce3d715b req-47882c07-3d9f-46d1-803c-94734f6a2763 service nova] Creating event network-vif-plugged:d7efa356-be18-4b34-8e2f-1021ac1dcb84 for instance 0fed6781-3a30-42e6-9787-79f2f12b53de on hv-cinder-83602 Aug 10 17:04:55.388071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-06b59a04-d425-42eb-b9aa-f484ce3d715b req-47882c07-3d9f-46d1-803c-94734f6a2763 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Aug 10 17:04:55.388705 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 578/1170] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:04:55.448343 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4441b545-a2d0-46eb-956f-0a39f6b5b2cc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:55.449195 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4441b545-a2d0-46eb-956f-0a39f6b5b2cc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:55.455742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4441b545-a2d0-46eb-956f-0a39f6b5b2cc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:55.456347 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4441b545-a2d0-46eb-956f-0a39f6b5b2cc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:55.456848 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4441b545-a2d0-46eb-956f-0a39f6b5b2cc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:55.457865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4441b545-a2d0-46eb-956f-0a39f6b5b2cc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:55.458394 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4441b545-a2d0-46eb-956f-0a39f6b5b2cc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:55.459002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4441b545-a2d0-46eb-956f-0a39f6b5b2cc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:55.610878 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1f1aa0a0-c9a0-4c36-af9a-95cd62719544 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:55.611575 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1f1aa0a0-c9a0-4c36-af9a-95cd62719544 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:55.617802 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f1aa0a0-c9a0-4c36-af9a-95cd62719544 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:55.618289 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f1aa0a0-c9a0-4c36-af9a-95cd62719544 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:55.618719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f1aa0a0-c9a0-4c36-af9a-95cd62719544 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:55.619415 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f1aa0a0-c9a0-4c36-af9a-95cd62719544 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:55.619871 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f1aa0a0-c9a0-4c36-af9a-95cd62719544 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:55.620320 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f1aa0a0-c9a0-4c36-af9a-95cd62719544 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:55.629252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4441b545-a2d0-46eb-956f-0a39f6b5b2cc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:55.637466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4441b545-a2d0-46eb-956f-0a39f6b5b2cc tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1367 microversion: 2.1 time: 0.193015 Aug 10 17:04:55.638053 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 593/1171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:55 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:55.745760 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:55.746361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:55.750940 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1f1aa0a0-c9a0-4c36-af9a-95cd62719544 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:55.752371 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:55.752861 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:55.753291 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:55.753974 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:55.754423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:55.754838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:55.758589 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1f1aa0a0-c9a0-4c36-af9a-95cd62719544 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.152565 Aug 10 17:04:55.759359 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 579/1172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:55 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:04:55.884270 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:55.892321 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:55.893832 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:55.895492 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0cf153e7-dafe-44f6-a96b-1b7c525fa50c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.153379 Aug 10 17:04:55.896539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 594/1173] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:04:55 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:04:56.779474 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-734c55ab-edac-40e7-a428-f525129cb124 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:56.780089 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-734c55ab-edac-40e7-a428-f525129cb124 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:56.786302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-734c55ab-edac-40e7-a428-f525129cb124 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:56.786776 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-734c55ab-edac-40e7-a428-f525129cb124 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:56.787204 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-734c55ab-edac-40e7-a428-f525129cb124 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:56.787883 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-734c55ab-edac-40e7-a428-f525129cb124 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:56.788359 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-734c55ab-edac-40e7-a428-f525129cb124 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:56.788778 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-734c55ab-edac-40e7-a428-f525129cb124 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:56.887854 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19b12f81-5bf5-428f-9f3f-c622a931d6e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:56.888498 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-19b12f81-5bf5-428f-9f3f-c622a931d6e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:56.894361 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b12f81-5bf5-428f-9f3f-c622a931d6e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:56.894841 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b12f81-5bf5-428f-9f3f-c622a931d6e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:56.895275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b12f81-5bf5-428f-9f3f-c622a931d6e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:56.895963 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b12f81-5bf5-428f-9f3f-c622a931d6e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:56.896443 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b12f81-5bf5-428f-9f3f-c622a931d6e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:56.896869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19b12f81-5bf5-428f-9f3f-c622a931d6e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:56.933648 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-734c55ab-edac-40e7-a428-f525129cb124 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:56.941591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-734c55ab-edac-40e7-a428-f525129cb124 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.165942 Aug 10 17:04:56.942165 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 595/1174] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:56 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:04:56.946626 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:56.947224 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:56.953550 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:56.954032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:56.954463 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:56.955275 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:56.955595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:56.956015 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:57.035084 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-19b12f81-5bf5-428f-9f3f-c622a931d6e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:57.042574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19b12f81-5bf5-428f-9f3f-c622a931d6e5 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1367 microversion: 2.1 time: 0.388174 Aug 10 17:04:57.043147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 580/1175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:56 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:57.084509 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:57.093296 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:57.094796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:57.095944 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e86135a5-da6c-4d93-8440-8df3b0c7de4e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.152878 Aug 10 17:04:57.096540 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 596/1176] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:04:56 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:04:57.963100 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ddf4494a-da83-47a8-93ce-954096f819b0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:57.963737 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ddf4494a-da83-47a8-93ce-954096f819b0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:57.970161 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf4494a-da83-47a8-93ce-954096f819b0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:57.970643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf4494a-da83-47a8-93ce-954096f819b0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:57.971068 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf4494a-da83-47a8-93ce-954096f819b0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:57.971747 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf4494a-da83-47a8-93ce-954096f819b0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:57.972227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf4494a-da83-47a8-93ce-954096f819b0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:57.972650 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf4494a-da83-47a8-93ce-954096f819b0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:58.063976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-190c2cd4-b9e2-44f5-a44a-793b8ffe793d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:58.064637 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-190c2cd4-b9e2-44f5-a44a-793b8ffe793d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:58.070815 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-190c2cd4-b9e2-44f5-a44a-793b8ffe793d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:58.071297 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-190c2cd4-b9e2-44f5-a44a-793b8ffe793d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:58.071731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-190c2cd4-b9e2-44f5-a44a-793b8ffe793d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:58.072487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-190c2cd4-b9e2-44f5-a44a-793b8ffe793d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:58.072941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-190c2cd4-b9e2-44f5-a44a-793b8ffe793d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:58.073360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-190c2cd4-b9e2-44f5-a44a-793b8ffe793d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:58.101510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ddf4494a-da83-47a8-93ce-954096f819b0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:58.109776 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ddf4494a-da83-47a8-93ce-954096f819b0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.150834 Aug 10 17:04:58.110427 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 581/1177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:57 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:58.118530 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:58.119225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:58.125823 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:58.126308 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:58.126738 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:58.127428 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:58.127877 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:58.128402 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:58.205638 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-190c2cd4-b9e2-44f5-a44a-793b8ffe793d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:58.213515 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-190c2cd4-b9e2-44f5-a44a-793b8ffe793d tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1557 microversion: 2.1 time: 0.154306 Aug 10 17:04:58.214018 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 597/1178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:58 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:04:58.234003 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-70c911c8-5b8f-4d0b-a15a-45afb42d8d30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:58.234496 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-70c911c8-5b8f-4d0b-a15a-45afb42d8d30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:58.240358 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70c911c8-5b8f-4d0b-a15a-45afb42d8d30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:58.240845 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70c911c8-5b8f-4d0b-a15a-45afb42d8d30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:58.241285 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70c911c8-5b8f-4d0b-a15a-45afb42d8d30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:58.241980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70c911c8-5b8f-4d0b-a15a-45afb42d8d30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:58.242430 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70c911c8-5b8f-4d0b-a15a-45afb42d8d30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:58.242853 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70c911c8-5b8f-4d0b-a15a-45afb42d8d30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:58.255575 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:58.263705 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:58.265263 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:58.266464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-db480457-9171-47c2-9519-c9e6671d6d2a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.151911 Aug 10 17:04:58.267027 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 582/1179] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:04:58 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:04:58.319551 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-70c911c8-5b8f-4d0b-a15a-45afb42d8d30 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089782 Aug 10 17:04:58.320170 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 598/1180] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Aug 10 17:04:58 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:04:59.131606 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de464656-69aa-4943-968a-d6c40d5ff6e3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:59.132281 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-de464656-69aa-4943-968a-d6c40d5ff6e3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:59.138697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de464656-69aa-4943-968a-d6c40d5ff6e3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:59.139149 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de464656-69aa-4943-968a-d6c40d5ff6e3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:59.139589 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de464656-69aa-4943-968a-d6c40d5ff6e3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:59.140318 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de464656-69aa-4943-968a-d6c40d5ff6e3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:59.140775 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de464656-69aa-4943-968a-d6c40d5ff6e3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:59.141204 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de464656-69aa-4943-968a-d6c40d5ff6e3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:59.232451 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-ffeae7e0-594f-4038-9575-447da78d8a02 req-ad6235b3-0748-4c1e-8568-f32fa6e98114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fed6781-3a30-42e6-9787-79f2f12b53de", "tag": "d7efa356-be18-4b34-8e2f-1021ac1dcb84"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:04:59.242587 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ffeae7e0-594f-4038-9575-447da78d8a02 req-ad6235b3-0748-4c1e-8568-f32fa6e98114 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:59.243385 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ffeae7e0-594f-4038-9575-447da78d8a02 req-ad6235b3-0748-4c1e-8568-f32fa6e98114 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:59.244410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-ffeae7e0-594f-4038-9575-447da78d8a02 req-ad6235b3-0748-4c1e-8568-f32fa6e98114 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:59.262080 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-ffeae7e0-594f-4038-9575-447da78d8a02 req-ad6235b3-0748-4c1e-8568-f32fa6e98114 service nova] Creating event network-changed:d7efa356-be18-4b34-8e2f-1021ac1dcb84 for instance 0fed6781-3a30-42e6-9787-79f2f12b53de on hv-cinder-83602 Aug 10 17:04:59.267293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-ffeae7e0-594f-4038-9575-447da78d8a02 req-ad6235b3-0748-4c1e-8568-f32fa6e98114 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039511 Aug 10 17:04:59.268076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 599/1181] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:04:59.285913 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-de464656-69aa-4943-968a-d6c40d5ff6e3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:59.290659 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:04:59.291506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:04:59.293535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-de464656-69aa-4943-968a-d6c40d5ff6e3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.165910 Aug 10 17:04:59.295228 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 583/1182] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:04:59 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:04:59.298809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:59.299447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:59.299884 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:59.300612 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:04:59.301068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:04:59.301489 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:04:59.526172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:59.535087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:59.537161 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:04:59.537967 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1980906e-4602-4a23-8ef1-963784fc34a6 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.251854 Aug 10 17:04:59.546114 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 600/1183] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:04:59 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:00.315452 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6a8c4495-6ac8-4459-9381-25cfe4d8a867 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:00.316000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6a8c4495-6ac8-4459-9381-25cfe4d8a867 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:00.322272 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8c4495-6ac8-4459-9381-25cfe4d8a867 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:00.322753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8c4495-6ac8-4459-9381-25cfe4d8a867 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:00.323185 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8c4495-6ac8-4459-9381-25cfe4d8a867 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:00.323872 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8c4495-6ac8-4459-9381-25cfe4d8a867 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:00.324347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8c4495-6ac8-4459-9381-25cfe4d8a867 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:00.324771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8c4495-6ac8-4459-9381-25cfe4d8a867 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:00.464009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6a8c4495-6ac8-4459-9381-25cfe4d8a867 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:00.475744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6a8c4495-6ac8-4459-9381-25cfe4d8a867 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.164215 Aug 10 17:05:00.476353 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 584/1184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:00 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:00.561478 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:00.562084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:00.570293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:00.571095 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:00.571790 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:00.572524 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:00.573080 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:00.573514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:00.706830 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:00.714971 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:00.717003 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:00.718158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bd371f0b-c101-457f-bf10-2f2747343287 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.161302 Aug 10 17:05:00.718714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 601/1185] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:00 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:01.497072 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-80f44c14-c5b9-44b7-9a80-d23bc15d2147 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:01.497612 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-80f44c14-c5b9-44b7-9a80-d23bc15d2147 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:01.503933 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f44c14-c5b9-44b7-9a80-d23bc15d2147 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:01.504436 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f44c14-c5b9-44b7-9a80-d23bc15d2147 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:01.504870 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f44c14-c5b9-44b7-9a80-d23bc15d2147 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:01.505555 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f44c14-c5b9-44b7-9a80-d23bc15d2147 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:01.506004 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f44c14-c5b9-44b7-9a80-d23bc15d2147 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:01.506424 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f44c14-c5b9-44b7-9a80-d23bc15d2147 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:01.649461 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-80f44c14-c5b9-44b7-9a80-d23bc15d2147 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:01.658251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-80f44c14-c5b9-44b7-9a80-d23bc15d2147 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.165092 Aug 10 17:05:01.659115 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 585/1186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:01 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:01.874639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:01.875284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:01.881076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:01.881559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:01.881990 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:01.882672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:01.883119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:01.883539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:02.015274 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:02.023017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:02.024529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:02.025663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6b885aec-b0a3-4dd5-a4f3-30eaded51c19 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.287970 Aug 10 17:05:02.026213 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 602/1187] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:01 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:02.679460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f6bd25a-aff5-4b01-88f2-145e7f8eac99 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:02.680102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6f6bd25a-aff5-4b01-88f2-145e7f8eac99 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:02.686495 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6bd25a-aff5-4b01-88f2-145e7f8eac99 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:02.686978 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6bd25a-aff5-4b01-88f2-145e7f8eac99 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:02.687411 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6bd25a-aff5-4b01-88f2-145e7f8eac99 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:02.688100 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6bd25a-aff5-4b01-88f2-145e7f8eac99 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:02.688576 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6bd25a-aff5-4b01-88f2-145e7f8eac99 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:02.688997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6bd25a-aff5-4b01-88f2-145e7f8eac99 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:02.817324 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6f6bd25a-aff5-4b01-88f2-145e7f8eac99 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:02.820794 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:02.826211 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f6bd25a-aff5-4b01-88f2-145e7f8eac99 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.150627 Aug 10 17:05:02.826767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 586/1188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:02 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:03.048587 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:03.049118 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:03.051490 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:03.056634 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:03.057123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:03.057566 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:03.058255 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:03.058709 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:03.059661 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:03.185917 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:03.193633 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:03.195120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:03.196286 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8ef38bb4-8063-41f7-8461-56fe1d31c72d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.151660 Aug 10 17:05:03.196837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 603/1189] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:03 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:03.847921 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51f5686a-1147-42eb-a20c-c020b90deda8 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:03.848553 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-51f5686a-1147-42eb-a20c-c020b90deda8 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:03.855303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f5686a-1147-42eb-a20c-c020b90deda8 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:03.855793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f5686a-1147-42eb-a20c-c020b90deda8 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:03.856679 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f5686a-1147-42eb-a20c-c020b90deda8 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:03.856957 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f5686a-1147-42eb-a20c-c020b90deda8 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:03.857446 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f5686a-1147-42eb-a20c-c020b90deda8 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:03.858406 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f5686a-1147-42eb-a20c-c020b90deda8 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:03.988998 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-51f5686a-1147-42eb-a20c-c020b90deda8 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:03.996586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-51f5686a-1147-42eb-a20c-c020b90deda8 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.152505 Aug 10 17:05:03.997159 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 587/1190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:03 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:04.218827 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:04.219433 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:04.225679 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:04.226163 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:04.226591 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:04.227277 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:04.227721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:04.228169 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:04.383827 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:04.391620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:04.393120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:04.394260 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4cd213b5-818d-4f50-8520-b9bd1410f422 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.179346 Aug 10 17:05:04.394804 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 604/1191] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:04 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:04.405770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:05:04.405945 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Wed Aug 10 17:05:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:05:05.017647 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a9a0775f-cf2e-460b-b365-35a5a6f92647 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:05.018283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a9a0775f-cf2e-460b-b365-35a5a6f92647 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:05.024595 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9a0775f-cf2e-460b-b365-35a5a6f92647 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:05.025078 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9a0775f-cf2e-460b-b365-35a5a6f92647 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:05.025511 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9a0775f-cf2e-460b-b365-35a5a6f92647 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:05.026193 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9a0775f-cf2e-460b-b365-35a5a6f92647 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:05.026641 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9a0775f-cf2e-460b-b365-35a5a6f92647 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:05.027060 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9a0775f-cf2e-460b-b365-35a5a6f92647 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:05.158656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9a0775f-cf2e-460b-b365-35a5a6f92647 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:05.165963 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a9a0775f-cf2e-460b-b365-35a5a6f92647 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.152346 Aug 10 17:05:05.166516 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 588/1192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:05 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:05.418259 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:05.418865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:05.427104 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:05.427581 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:05.428011 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:05.428723 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:05.429168 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:05.429585 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:05.555693 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:05.564240 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:05.565683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:05.566837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-dcaa2c22-b470-45b6-b922-e96eedddbc1a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.152493 Aug 10 17:05:05.567394 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 605/1193] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:05 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:06.186689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-484f5389-2dd9-47d6-8f6e-85c6e6b7b1c1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:06.187330 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-484f5389-2dd9-47d6-8f6e-85c6e6b7b1c1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:06.193637 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484f5389-2dd9-47d6-8f6e-85c6e6b7b1c1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:06.194125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484f5389-2dd9-47d6-8f6e-85c6e6b7b1c1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:06.194556 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484f5389-2dd9-47d6-8f6e-85c6e6b7b1c1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:06.195241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484f5389-2dd9-47d6-8f6e-85c6e6b7b1c1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:06.195690 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484f5389-2dd9-47d6-8f6e-85c6e6b7b1c1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:06.196110 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484f5389-2dd9-47d6-8f6e-85c6e6b7b1c1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:06.322552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-484f5389-2dd9-47d6-8f6e-85c6e6b7b1c1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:06.331052 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-484f5389-2dd9-47d6-8f6e-85c6e6b7b1c1 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.148198 Aug 10 17:05:06.331637 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 589/1194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:06 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:06.590336 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:06.590949 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:06.597716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:06.598191 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:06.598615 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:06.599300 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:06.599742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:06.600170 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:06.734497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:06.742298 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:06.743810 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:06.745001 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1e495bc7-da4f-4068-be50-11381c0f9f75 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1744 microversion: 2.20 time: 0.158628 Aug 10 17:05:06.745567 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 606/1195] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:06 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:07.353736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-795c0c44-b682-462c-a1aa-88de10e6815a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:07.354397 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-795c0c44-b682-462c-a1aa-88de10e6815a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:07.361692 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795c0c44-b682-462c-a1aa-88de10e6815a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:07.362170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795c0c44-b682-462c-a1aa-88de10e6815a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:07.362607 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795c0c44-b682-462c-a1aa-88de10e6815a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:07.363322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795c0c44-b682-462c-a1aa-88de10e6815a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:07.363782 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795c0c44-b682-462c-a1aa-88de10e6815a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:07.364269 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795c0c44-b682-462c-a1aa-88de10e6815a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:07.503215 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-795c0c44-b682-462c-a1aa-88de10e6815a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:07.510740 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-795c0c44-b682-462c-a1aa-88de10e6815a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1511 microversion: 2.1 time: 0.160991 Aug 10 17:05:07.511304 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 590/1196] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:07 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:07.531125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-da0a6c30-24c8-4e16-a4d3-444e5e634cbf tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:05:07.531714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-da0a6c30-24c8-4e16-a4d3-444e5e634cbf tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:07.537635 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da0a6c30-24c8-4e16-a4d3-444e5e634cbf tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:07.538111 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da0a6c30-24c8-4e16-a4d3-444e5e634cbf tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:07.538538 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da0a6c30-24c8-4e16-a4d3-444e5e634cbf tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:07.539215 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da0a6c30-24c8-4e16-a4d3-444e5e634cbf tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:07.539660 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da0a6c30-24c8-4e16-a4d3-444e5e634cbf tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:07.540076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da0a6c30-24c8-4e16-a4d3-444e5e634cbf tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:07.558208 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:07.570868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-da0a6c30-24c8-4e16-a4d3-444e5e634cbf tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120608) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 17:05:07.633407 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-da0a6c30-24c8-4e16-a4d3-444e5e634cbf tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "POST /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223/action" status: 202 len: 0 microversion: 2.1 time: 0.106693 Aug 10 17:05:07.638993 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 607/1197] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 17:05:07 2022] POST /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:05:07.648343 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d46328b2-2412-400e-9dcc-7a9448eedf79 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:07.649255 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d46328b2-2412-400e-9dcc-7a9448eedf79 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:07.655554 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d46328b2-2412-400e-9dcc-7a9448eedf79 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:07.656495 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d46328b2-2412-400e-9dcc-7a9448eedf79 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:07.656939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d46328b2-2412-400e-9dcc-7a9448eedf79 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:07.658173 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d46328b2-2412-400e-9dcc-7a9448eedf79 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:07.659021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d46328b2-2412-400e-9dcc-7a9448eedf79 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:07.659741 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d46328b2-2412-400e-9dcc-7a9448eedf79 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:07.767815 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:07.768959 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:07.775797 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:07.776564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:07.777507 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:07.778398 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:07.779985 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:07.780931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:07.805093 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d46328b2-2412-400e-9dcc-7a9448eedf79 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:07.814667 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d46328b2-2412-400e-9dcc-7a9448eedf79 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1519 microversion: 2.1 time: 0.172920 Aug 10 17:05:07.827156 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 591/1198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:07 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:07.964037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:07.973275 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:07.974865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:07.976263 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0ce24931-ef9a-4459-91b0-bb23616a5162 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1744 microversion: 2.20 time: 0.213244 Aug 10 17:05:07.976821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 608/1199] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:07 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1744 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:08.835653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f2f08f7a-2c93-4d16-baed-365ed5820305 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:08.836290 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f2f08f7a-2c93-4d16-baed-365ed5820305 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:08.843330 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2f08f7a-2c93-4d16-baed-365ed5820305 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:08.843797 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2f08f7a-2c93-4d16-baed-365ed5820305 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:08.844267 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2f08f7a-2c93-4d16-baed-365ed5820305 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:08.844961 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2f08f7a-2c93-4d16-baed-365ed5820305 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:08.845411 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2f08f7a-2c93-4d16-baed-365ed5820305 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:08.845835 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2f08f7a-2c93-4d16-baed-365ed5820305 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:08.975586 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f2f08f7a-2c93-4d16-baed-365ed5820305 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:08.983066 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f2f08f7a-2c93-4d16-baed-365ed5820305 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1521 microversion: 2.1 time: 0.151445 Aug 10 17:05:08.983623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 592/1200] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:08 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:08.998784 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:08.999691 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:09.006032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:09.006514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:09.006947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:09.007638 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:09.008090 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:09.008542 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:09.138318 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:09.146674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:09.148215 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:09.149374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-76d2b73b-526d-493b-bafe-666340769a59 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1744 microversion: 2.20 time: 0.154568 Aug 10 17:05:09.149928 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 609/1201] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:08 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:09.430850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b3369f49-e84e-4ebf-ac2c-d1d6849f9eab req-8f15d3f8-1b44-490e-87cc-8f46df6b2c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55af62cb-d5be-4fef-b179-39240d0b13cb", "name": "network-vif-plugged", "status": "completed", "tag": "228e4301-98ff-4548-915d-d44107e8a96d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:05:09.441074 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b3369f49-e84e-4ebf-ac2c-d1d6849f9eab req-8f15d3f8-1b44-490e-87cc-8f46df6b2c62 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:09.441559 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b3369f49-e84e-4ebf-ac2c-d1d6849f9eab req-8f15d3f8-1b44-490e-87cc-8f46df6b2c62 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:09.441998 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b3369f49-e84e-4ebf-ac2c-d1d6849f9eab req-8f15d3f8-1b44-490e-87cc-8f46df6b2c62 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:09.454380 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b3369f49-e84e-4ebf-ac2c-d1d6849f9eab req-8f15d3f8-1b44-490e-87cc-8f46df6b2c62 service nova] Creating event network-vif-plugged:228e4301-98ff-4548-915d-d44107e8a96d for instance 55af62cb-d5be-4fef-b179-39240d0b13cb on hv-cinder-83602 Aug 10 17:05:09.460202 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b3369f49-e84e-4ebf-ac2c-d1d6849f9eab req-8f15d3f8-1b44-490e-87cc-8f46df6b2c62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032849 Aug 10 17:05:09.460948 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 593/1202] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:05:10.004916 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e450008e-2b0a-4bef-96d4-32a784072f06 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:10.005624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e450008e-2b0a-4bef-96d4-32a784072f06 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:10.011971 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e450008e-2b0a-4bef-96d4-32a784072f06 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:10.012499 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e450008e-2b0a-4bef-96d4-32a784072f06 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:10.012930 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e450008e-2b0a-4bef-96d4-32a784072f06 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:10.013624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e450008e-2b0a-4bef-96d4-32a784072f06 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:10.014076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e450008e-2b0a-4bef-96d4-32a784072f06 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:10.014497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e450008e-2b0a-4bef-96d4-32a784072f06 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:10.173892 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:10.174576 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:10.180623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:10.181109 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:10.181531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:10.182217 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:10.182664 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:10.183085 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:10.220902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e450008e-2b0a-4bef-96d4-32a784072f06 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:10.229458 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e450008e-2b0a-4bef-96d4-32a784072f06 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.227538 Aug 10 17:05:10.229458 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 610/1203] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:09 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:10.314838 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:10.322807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:10.324347 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:10.325516 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6461d581-6c45-4de8-bf4e-291d8802aeb1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1744 microversion: 2.20 time: 0.156357 Aug 10 17:05:10.326082 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 594/1204] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:10 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:11.250499 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7c37bc98-c75c-4798-88d7-eae6f28bfb60 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:11.251112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7c37bc98-c75c-4798-88d7-eae6f28bfb60 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:11.257545 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c37bc98-c75c-4798-88d7-eae6f28bfb60 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:11.258026 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c37bc98-c75c-4798-88d7-eae6f28bfb60 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:11.258464 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c37bc98-c75c-4798-88d7-eae6f28bfb60 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:11.259150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c37bc98-c75c-4798-88d7-eae6f28bfb60 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:11.259597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c37bc98-c75c-4798-88d7-eae6f28bfb60 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:11.260020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c37bc98-c75c-4798-88d7-eae6f28bfb60 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:11.349689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:11.350833 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:11.357642 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:11.358363 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:11.359297 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:11.360006 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:11.360489 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:11.364826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:11.393614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7c37bc98-c75c-4798-88d7-eae6f28bfb60 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:11.401446 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7c37bc98-c75c-4798-88d7-eae6f28bfb60 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.155381 Aug 10 17:05:11.402042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 611/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:11 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:11.475491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-858db686-6c5a-470b-ab55-a2ff369109e0 req-1d892a2a-0c12-4bc3-ac56-af178e5885f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca57c21-5ab9-42f0-ba5c-158b397c8223", "name": "network-vif-unplugged", "status": "completed", "tag": "25c45962-3be8-4f45-8373-a67dfc93aa99"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:05:11.485427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-858db686-6c5a-470b-ab55-a2ff369109e0 req-1d892a2a-0c12-4bc3-ac56-af178e5885f8 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:11.485990 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-858db686-6c5a-470b-ab55-a2ff369109e0 req-1d892a2a-0c12-4bc3-ac56-af178e5885f8 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:11.486490 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-858db686-6c5a-470b-ab55-a2ff369109e0 req-1d892a2a-0c12-4bc3-ac56-af178e5885f8 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:11.494123 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:11.497604 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-858db686-6c5a-470b-ab55-a2ff369109e0 req-1d892a2a-0c12-4bc3-ac56-af178e5885f8 service nova] Creating event network-vif-unplugged:25c45962-3be8-4f45-8373-a67dfc93aa99 for instance cca57c21-5ab9-42f0-ba5c-158b397c8223 on hv-cinder-83602 Aug 10 17:05:11.502714 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:11.503272 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-858db686-6c5a-470b-ab55-a2ff369109e0 req-1d892a2a-0c12-4bc3-ac56-af178e5885f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031390 Aug 10 17:05:11.503939 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 612/1206] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:05:11.504248 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:11.505486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f59cb3fb-af50-4ec6-abdd-570258717280 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1744 microversion: 2.20 time: 0.159678 Aug 10 17:05:11.506286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 595/1207] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:11 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:12.422796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ca9f245d-dd1e-437e-a63e-856b4244edab tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:12.423539 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ca9f245d-dd1e-437e-a63e-856b4244edab tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:12.430145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca9f245d-dd1e-437e-a63e-856b4244edab tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:12.430623 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca9f245d-dd1e-437e-a63e-856b4244edab tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:12.431052 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca9f245d-dd1e-437e-a63e-856b4244edab tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:12.431745 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca9f245d-dd1e-437e-a63e-856b4244edab tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:12.432269 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca9f245d-dd1e-437e-a63e-856b4244edab tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:12.432691 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca9f245d-dd1e-437e-a63e-856b4244edab tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:12.527984 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:12.528687 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:12.535087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:12.535574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:12.536017 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:12.536742 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:12.537194 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:12.537619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:12.562683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ca9f245d-dd1e-437e-a63e-856b4244edab tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:12.571598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ca9f245d-dd1e-437e-a63e-856b4244edab tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.152931 Aug 10 17:05:12.572187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 613/1208] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:12 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:12.669865 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:12.680010 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:12.681536 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:12.682695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c5e24c02-b3d6-45d0-8a85-f344f202f1df tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1744 microversion: 2.20 time: 0.158610 Aug 10 17:05:12.683247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 596/1209] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:12 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:13.598054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8caf456d-1aa1-46f7-b868-74a7d0723a7c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:13.598743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8caf456d-1aa1-46f7-b868-74a7d0723a7c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:13.605502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8caf456d-1aa1-46f7-b868-74a7d0723a7c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:13.605982 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8caf456d-1aa1-46f7-b868-74a7d0723a7c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:13.606416 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8caf456d-1aa1-46f7-b868-74a7d0723a7c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:13.607107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8caf456d-1aa1-46f7-b868-74a7d0723a7c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:13.607553 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8caf456d-1aa1-46f7-b868-74a7d0723a7c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:13.607969 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8caf456d-1aa1-46f7-b868-74a7d0723a7c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:13.707306 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:13.708869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:13.716283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:13.717037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:13.717702 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:13.720282 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:13.720951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:13.721641 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:13.784303 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8caf456d-1aa1-46f7-b868-74a7d0723a7c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:13.793911 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8caf456d-1aa1-46f7-b868-74a7d0723a7c tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.201212 Aug 10 17:05:13.794904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 614/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:13 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:13.877704 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:13.886170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:13.888101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:13.890426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f662edd9-6a1b-4240-a62f-4733fe8d3bc7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1739 microversion: 2.20 time: 0.187441 Aug 10 17:05:13.904168 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 597/1211] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:13 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:14.815100 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a5a01211-0de6-4e85-a630-33c8756cad68 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:14.816105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a5a01211-0de6-4e85-a630-33c8756cad68 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:14.829653 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01211-0de6-4e85-a630-33c8756cad68 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:14.830145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01211-0de6-4e85-a630-33c8756cad68 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:14.830577 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01211-0de6-4e85-a630-33c8756cad68 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:14.831272 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01211-0de6-4e85-a630-33c8756cad68 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:14.831721 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01211-0de6-4e85-a630-33c8756cad68 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:14.832175 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01211-0de6-4e85-a630-33c8756cad68 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:14.914919 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:14.915767 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:14.924418 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:14.925288 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:14.926146 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:14.927085 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:14.927762 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:14.928417 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:15.004640 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a5a01211-0de6-4e85-a630-33c8756cad68 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:15.013686 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a5a01211-0de6-4e85-a630-33c8756cad68 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.202428 Aug 10 17:05:15.014264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 615/1212] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:14 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:15.074956 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:15.085774 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:15.089991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:15.091183 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-82ab728a-3c23-4e39-9122-97914c5b3b6c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1739 microversion: 2.20 time: 0.180314 Aug 10 17:05:15.091745 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 598/1213] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:14 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:16.034920 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d2eb3b7c-edde-432a-94a4-8d19d334d160 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:16.035529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d2eb3b7c-edde-432a-94a4-8d19d334d160 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:16.042351 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b7c-edde-432a-94a4-8d19d334d160 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:16.042927 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b7c-edde-432a-94a4-8d19d334d160 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:16.043592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b7c-edde-432a-94a4-8d19d334d160 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:16.044395 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b7c-edde-432a-94a4-8d19d334d160 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:16.045048 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b7c-edde-432a-94a4-8d19d334d160 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:16.045517 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b7c-edde-432a-94a4-8d19d334d160 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:16.117344 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:16.118019 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:16.131986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:16.132500 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:16.133022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:16.134145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:16.134678 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:16.135273 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:16.244920 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d2eb3b7c-edde-432a-94a4-8d19d334d160 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:16.253244 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d2eb3b7c-edde-432a-94a4-8d19d334d160 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.222343 Aug 10 17:05:16.264864 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 616/1214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:16 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:16.296750 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:16.304727 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:16.306244 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:16.307427 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e62c5ae1-021d-42ad-ae7a-b1e8271930c5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1739 microversion: 2.20 time: 0.195991 Aug 10 17:05:16.307988 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 599/1215] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:16 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:17.274541 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4272354b-c40f-4bb2-9707-4d2a7bea6726 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:17.275152 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4272354b-c40f-4bb2-9707-4d2a7bea6726 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:17.281980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4272354b-c40f-4bb2-9707-4d2a7bea6726 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:17.282476 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4272354b-c40f-4bb2-9707-4d2a7bea6726 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:17.282914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4272354b-c40f-4bb2-9707-4d2a7bea6726 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:17.283795 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4272354b-c40f-4bb2-9707-4d2a7bea6726 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:17.284467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4272354b-c40f-4bb2-9707-4d2a7bea6726 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:17.284899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4272354b-c40f-4bb2-9707-4d2a7bea6726 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:17.331783 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:17.332487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:17.346526 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:17.347101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:17.347737 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:17.348670 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:17.349128 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:17.349588 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:17.445305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4272354b-c40f-4bb2-9707-4d2a7bea6726 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:17.452835 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4272354b-c40f-4bb2-9707-4d2a7bea6726 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.182080 Aug 10 17:05:17.454257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 617/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:17 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:17.506430 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:17.514442 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:17.515965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:17.517175 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47c4ff30-07ec-454d-9410-a3f5cfdade74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1739 microversion: 2.20 time: 0.190152 Aug 10 17:05:17.517962 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 600/1217] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:17 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:18.477713 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4f137d28-d7c9-4d7c-8cd6-d17fdbeb5c2d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:18.478963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4f137d28-d7c9-4d7c-8cd6-d17fdbeb5c2d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:18.486980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f137d28-d7c9-4d7c-8cd6-d17fdbeb5c2d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:18.487770 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f137d28-d7c9-4d7c-8cd6-d17fdbeb5c2d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:18.488502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f137d28-d7c9-4d7c-8cd6-d17fdbeb5c2d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:18.489689 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f137d28-d7c9-4d7c-8cd6-d17fdbeb5c2d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:18.490219 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f137d28-d7c9-4d7c-8cd6-d17fdbeb5c2d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:18.490731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f137d28-d7c9-4d7c-8cd6-d17fdbeb5c2d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:18.541001 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:18.542470 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:18.550824 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:18.551399 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:18.551939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:18.552925 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:18.553486 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:18.554076 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:18.638729 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4f137d28-d7c9-4d7c-8cd6-d17fdbeb5c2d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:18.649858 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4f137d28-d7c9-4d7c-8cd6-d17fdbeb5c2d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.177886 Aug 10 17:05:18.665492 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 618/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:18 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:18.703412 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:18.712384 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:18.714238 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:18.715410 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-35d50416-c4df-4cf0-9cb4-94296be1a750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1739 microversion: 2.20 time: 0.178393 Aug 10 17:05:18.715961 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 601/1219] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:18 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:19.675347 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-18e2ea76-bcb3-44fc-9347-7700da81c00d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:19.675958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-18e2ea76-bcb3-44fc-9347-7700da81c00d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:19.683382 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18e2ea76-bcb3-44fc-9347-7700da81c00d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:19.683979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18e2ea76-bcb3-44fc-9347-7700da81c00d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:19.684664 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18e2ea76-bcb3-44fc-9347-7700da81c00d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:19.685361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18e2ea76-bcb3-44fc-9347-7700da81c00d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:19.685979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18e2ea76-bcb3-44fc-9347-7700da81c00d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:19.686404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18e2ea76-bcb3-44fc-9347-7700da81c00d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:19.739012 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:19.739625 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:19.746024 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:19.746825 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:19.747190 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:19.748075 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:19.748714 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:19.749143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:19.849752 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-18e2ea76-bcb3-44fc-9347-7700da81c00d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:19.862413 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-18e2ea76-bcb3-44fc-9347-7700da81c00d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.191550 Aug 10 17:05:19.863497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 619/1220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:19 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:19.899140 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:19.907423 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:19.909241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:19.910394 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-85090d0d-3259-47be-ab48-d43e9ff9eb92 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1739 microversion: 2.20 time: 0.175819 Aug 10 17:05:19.911254 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 602/1221] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:19 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:20.884716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bc40f8b1-1675-4f30-a4da-9d1d1ab67e22 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:20.885372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bc40f8b1-1675-4f30-a4da-9d1d1ab67e22 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:20.892729 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc40f8b1-1675-4f30-a4da-9d1d1ab67e22 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:20.893228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc40f8b1-1675-4f30-a4da-9d1d1ab67e22 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:20.893665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc40f8b1-1675-4f30-a4da-9d1d1ab67e22 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:20.894369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc40f8b1-1675-4f30-a4da-9d1d1ab67e22 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:20.894844 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc40f8b1-1675-4f30-a4da-9d1d1ab67e22 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:20.895338 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc40f8b1-1675-4f30-a4da-9d1d1ab67e22 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:20.933972 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:20.935578 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:20.943565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:20.944565 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:20.945240 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:20.946236 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:20.946886 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:20.947504 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:21.043545 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bc40f8b1-1675-4f30-a4da-9d1d1ab67e22 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:21.052019 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bc40f8b1-1675-4f30-a4da-9d1d1ab67e22 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.171367 Aug 10 17:05:21.053002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 620/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:20 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:21.101280 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:21.116408 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:21.119135 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:21.120982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d1599dd8-406f-41d4-aa24-8bc27be5a49e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1739 microversion: 2.20 time: 0.190832 Aug 10 17:05:21.121861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 603/1223] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:20 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:21.491220 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-aada19b9-7550-4f7b-b454-ed8ea63c5bd6 req-b691584e-36ae-4199-80b0-5d0ba9a47d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca57c21-5ab9-42f0-ba5c-158b397c8223", "name": "network-vif-plugged", "status": "completed", "tag": "25c45962-3be8-4f45-8373-a67dfc93aa99"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:05:21.503015 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-aada19b9-7550-4f7b-b454-ed8ea63c5bd6 req-b691584e-36ae-4199-80b0-5d0ba9a47d15 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:21.503445 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-aada19b9-7550-4f7b-b454-ed8ea63c5bd6 req-b691584e-36ae-4199-80b0-5d0ba9a47d15 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:21.503880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-aada19b9-7550-4f7b-b454-ed8ea63c5bd6 req-b691584e-36ae-4199-80b0-5d0ba9a47d15 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:21.520077 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-aada19b9-7550-4f7b-b454-ed8ea63c5bd6 req-b691584e-36ae-4199-80b0-5d0ba9a47d15 service nova] Creating event network-vif-plugged:25c45962-3be8-4f45-8373-a67dfc93aa99 for instance cca57c21-5ab9-42f0-ba5c-158b397c8223 on hv-cinder-83602 Aug 10 17:05:21.525737 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-aada19b9-7550-4f7b-b454-ed8ea63c5bd6 req-b691584e-36ae-4199-80b0-5d0ba9a47d15 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038909 Aug 10 17:05:21.526423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 621/1224] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:05:22.077403 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a926161-a5e1-45c4-8c8a-9a211173b92e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:22.082496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a926161-a5e1-45c4-8c8a-9a211173b92e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:22.091548 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a926161-a5e1-45c4-8c8a-9a211173b92e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:22.092797 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a926161-a5e1-45c4-8c8a-9a211173b92e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:22.093464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a926161-a5e1-45c4-8c8a-9a211173b92e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:22.094889 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a926161-a5e1-45c4-8c8a-9a211173b92e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:22.097844 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a926161-a5e1-45c4-8c8a-9a211173b92e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:22.098468 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a926161-a5e1-45c4-8c8a-9a211173b92e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:22.105460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:22.149543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:22.150940 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:22.160518 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:22.161368 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:22.162029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:22.163191 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:22.164658 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:22.165561 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:22.296628 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8a926161-a5e1-45c4-8c8a-9a211173b92e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:22.306605 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a926161-a5e1-45c4-8c8a-9a211173b92e tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.233068 Aug 10 17:05:22.307499 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 604/1225] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:22 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:22.348445 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:22.359023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:22.361577 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:22.362969 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5c54448a-2177-42f4-b1f5-b6308ce98c79 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1739 microversion: 2.20 time: 0.219244 Aug 10 17:05:22.364498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 622/1226] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:22 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:23.327092 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ff9d72fa-0a21-4f6f-aac0-8a059544c9fd tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:23.328062 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ff9d72fa-0a21-4f6f-aac0-8a059544c9fd tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:23.334474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff9d72fa-0a21-4f6f-aac0-8a059544c9fd tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:23.335218 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff9d72fa-0a21-4f6f-aac0-8a059544c9fd tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:23.335649 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff9d72fa-0a21-4f6f-aac0-8a059544c9fd tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:23.336364 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff9d72fa-0a21-4f6f-aac0-8a059544c9fd tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:23.336815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff9d72fa-0a21-4f6f-aac0-8a059544c9fd tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:23.337234 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff9d72fa-0a21-4f6f-aac0-8a059544c9fd tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:23.386914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:23.387519 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:23.395452 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:23.403514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:23.404291 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:23.405259 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:23.405802 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:23.406370 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:23.522648 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ff9d72fa-0a21-4f6f-aac0-8a059544c9fd tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:23.532000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ff9d72fa-0a21-4f6f-aac0-8a059544c9fd tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1577 microversion: 2.1 time: 0.208675 Aug 10 17:05:23.533302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 605/1227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:23 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1577 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:23.575827 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:23.585437 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:23.586927 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:23.588331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a4a66478-2a4f-443b-9310-5756972af2be tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1739 microversion: 2.20 time: 0.205356 Aug 10 17:05:23.589354 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 623/1228] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:23 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:24.554801 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ad60f278-b088-4779-b3d3-2e3a4c4f7570 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:24.555414 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ad60f278-b088-4779-b3d3-2e3a4c4f7570 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:24.557894 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=60 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:24.563314 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad60f278-b088-4779-b3d3-2e3a4c4f7570 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:24.563807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad60f278-b088-4779-b3d3-2e3a4c4f7570 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:24.564279 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad60f278-b088-4779-b3d3-2e3a4c4f7570 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:24.564977 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad60f278-b088-4779-b3d3-2e3a4c4f7570 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:24.565436 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad60f278-b088-4779-b3d3-2e3a4c4f7570 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:24.565864 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad60f278-b088-4779-b3d3-2e3a4c4f7570 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:24.612403 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:24.613007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:24.619393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:24.619865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:24.620330 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:24.621009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:24.621453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:24.621870 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:24.639657 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:24.697101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ad60f278-b088-4779-b3d3-2e3a4c4f7570 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:24.704937 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ad60f278-b088-4779-b3d3-2e3a4c4f7570 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1564 microversion: 2.1 time: 0.153955 Aug 10 17:05:24.705709 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 606/1229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:05:24 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:05:24.752708 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:24.760627 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:24.762129 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:24.763280 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-379572c3-e5d6-47e0-90f9-9e3f330b034f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1739 microversion: 2.20 time: 0.155665 Aug 10 17:05:24.763836 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 624/1230] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:24 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:25.786027 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:25.786630 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:25.792915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:25.793398 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:25.793829 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:25.794519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:25.794974 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:25.795455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:25.922992 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:25.931046 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:25.932560 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:25.933701 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08a3526b-0fb8-4c34-8176-fd368b7b06f1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1721 microversion: 2.20 time: 0.151557 Aug 10 17:05:25.934254 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 607/1231] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:25 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:26.957242 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:26.957841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:26.964435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:26.964908 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:26.965341 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:26.966019 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:26.966463 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:26.966878 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:27.096059 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:27.104259 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:27.105758 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:27.106913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-62c9089d-fe7e-4abb-afa1-9ff53d192a1d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1721 microversion: 2.20 time: 0.154360 Aug 10 17:05:27.107473 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 625/1232] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:26 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:28.130643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:28.131257 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:28.137739 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:28.138227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:28.138667 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:28.139368 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:28.139824 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:28.140807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:28.279965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:28.288003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:28.289545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:28.290706 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f5fa0cf7-96ee-4e67-b747-d63e035d973d tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1724 microversion: 2.20 time: 0.164034 Aug 10 17:05:28.291268 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 608/1233] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:28 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:28.313410 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6ca4f546-8046-41c1-bd03-50efe816e475 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f60c8af6-6119-44f2-bab8-3b48ffbcc4ca"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:05:28.315739 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6ca4f546-8046-41c1-bd03-50efe816e475 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:28.322069 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca4f546-8046-41c1-bd03-50efe816e475 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:28.322553 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca4f546-8046-41c1-bd03-50efe816e475 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:28.323002 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca4f546-8046-41c1-bd03-50efe816e475 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:28.323692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca4f546-8046-41c1-bd03-50efe816e475 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:28.324168 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca4f546-8046-41c1-bd03-50efe816e475 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:28.324594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca4f546-8046-41c1-bd03-50efe816e475 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:28.582129 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6ca4f546-8046-41c1-bd03-50efe816e475 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "POST /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.273260 Aug 10 17:05:28.582767 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 626/1234] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Aug 10 17:05:28 2022] POST /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/os-volume_attachments => generated 188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:05:28.704551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4114704-3c1e-482b-b4c3-eca0a38ec6a5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:28.705052 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4114704-3c1e-482b-b4c3-eca0a38ec6a5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:28.711101 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4114704-3c1e-482b-b4c3-eca0a38ec6a5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:28.711576 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4114704-3c1e-482b-b4c3-eca0a38ec6a5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:28.712002 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4114704-3c1e-482b-b4c3-eca0a38ec6a5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:28.712708 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4114704-3c1e-482b-b4c3-eca0a38ec6a5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:28.713156 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4114704-3c1e-482b-b4c3-eca0a38ec6a5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:28.713577 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4114704-3c1e-482b-b4c3-eca0a38ec6a5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:28.954449 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4114704-3c1e-482b-b4c3-eca0a38ec6a5 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "DELETE /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/os-volume_attachments/f60c8af6-6119-44f2-bab8-3b48ffbcc4ca" status: 202 len: 0 microversion: 2.20 time: 0.253788 Aug 10 17:05:28.955145 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 609/1235] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Aug 10 17:05:28 2022] DELETE /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/os-volume_attachments/f60c8af6-6119-44f2-bab8-3b48ffbcc4ca => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:05:29.013060 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4657e836-c2d8-4672-917d-06f52d479ede tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:05:29.013659 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4657e836-c2d8-4672-917d-06f52d479ede tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:29.019404 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4657e836-c2d8-4672-917d-06f52d479ede tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:29.019887 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4657e836-c2d8-4672-917d-06f52d479ede tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:29.020357 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4657e836-c2d8-4672-917d-06f52d479ede tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:29.021043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4657e836-c2d8-4672-917d-06f52d479ede tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:29.021494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4657e836-c2d8-4672-917d-06f52d479ede tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:29.021914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4657e836-c2d8-4672-917d-06f52d479ede tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:29.053113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4657e836-c2d8-4672-917d-06f52d479ede tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120608) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 17:05:29.116963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4657e836-c2d8-4672-917d-06f52d479ede tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "POST /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/action" status: 202 len: 0 microversion: 2.20 time: 0.107739 Aug 10 17:05:29.117562 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 627/1236] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Aug 10 17:05:29 2022] POST /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:05:29.125754 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:29.126362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:29.132720 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:29.133231 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:29.133623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:29.134339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:29.134792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:29.135211 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:29.267833 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:29.275846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:29.277488 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:29.278645 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-36fdd683-5430-4e19-afc5-b46772fda5d1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1672 microversion: 2.20 time: 0.156914 Aug 10 17:05:29.279218 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 610/1237] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:29 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:29.496705 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-35e15631-98df-41a8-a27d-4ecd8a97934c req-00821279-286e-4dce-8eee-a23c5c698ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55af62cb-d5be-4fef-b179-39240d0b13cb", "name": "network-vif-unplugged", "status": "completed", "tag": "228e4301-98ff-4548-915d-d44107e8a96d"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:05:29.506241 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-35e15631-98df-41a8-a27d-4ecd8a97934c req-00821279-286e-4dce-8eee-a23c5c698ec5 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:29.506951 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-35e15631-98df-41a8-a27d-4ecd8a97934c req-00821279-286e-4dce-8eee-a23c5c698ec5 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:29.507373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-35e15631-98df-41a8-a27d-4ecd8a97934c req-00821279-286e-4dce-8eee-a23c5c698ec5 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:29.519816 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.compute.server_external_events [req-35e15631-98df-41a8-a27d-4ecd8a97934c req-00821279-286e-4dce-8eee-a23c5c698ec5 service nova] Unable to find a host for instance 55af62cb-d5be-4fef-b179-39240d0b13cb. Dropping event network-vif-unplugged {{(pid=120608) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 17:05:29.520735 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-35e15631-98df-41a8-a27d-4ecd8a97934c req-00821279-286e-4dce-8eee-a23c5c698ec5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028358 Aug 10 17:05:29.521321 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 628/1238] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 17:05:30.302271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:30.302861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:30.308989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:30.309472 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:30.309922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:30.310600 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:30.311060 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:30.311485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:30.444029 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:30.452016 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:30.453818 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:30.454983 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-323efa41-8e8a-400d-be2b-a01550d8dee3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.156642 Aug 10 17:05:30.455541 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 611/1239] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:30 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:31.478614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:31.479257 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:31.486893 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:31.487386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:31.487850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:31.488579 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:31.489032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:31.489459 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:31.627848 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:31.637007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:31.638529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:31.639699 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6f3f1512-779d-4a2d-81fc-f7b213fa1dfc tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.165123 Aug 10 17:05:31.640804 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 629/1240] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:31 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:32.664227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:32.665845 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:32.673325 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:32.674047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:32.675057 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:32.675776 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:32.676283 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:32.676706 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:32.811086 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:32.822779 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:32.824323 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:32.825496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a959af7-bf07-4b0c-bb6c-0a7ba6dc7fe8 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.165344 Aug 10 17:05:32.826093 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 612/1241] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:32 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:33.848530 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:33.849140 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:33.851503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:33.856665 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:33.857158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:33.857593 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:33.858293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:33.858740 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:33.859667 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:33.993194 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:34.001752 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:34.003258 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:34.004523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4587f8d8-6a10-442e-88a2-caab40ba7bc1 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.159953 Aug 10 17:05:34.005083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 630/1242] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:33 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:35.027407 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:35.027997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:35.035025 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:35.035507 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:35.035940 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:35.036663 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:35.037117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:35.037538 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:35.169830 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:35.178345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:35.179845 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:35.181037 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8b6d89df-1509-4765-bc8f-b71c1187a87e tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.157521 Aug 10 17:05:35.181596 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 613/1243] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:35 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:36.204442 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:36.205049 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:36.212491 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:36.213061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:36.213620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:36.214588 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:36.215080 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:36.215647 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:36.356758 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:36.365095 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:36.366675 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:36.367847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-89f1946c-1436-478f-bf66-d71d56358915 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.167883 Aug 10 17:05:36.368454 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 631/1244] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:36 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:37.391647 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:37.392321 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:37.398738 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:37.399219 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:37.399653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:37.400411 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:37.400869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:37.401295 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:37.539735 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:37.549405 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:37.550999 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:37.552218 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce2aa120-c7ce-4823-ac80-0ea1cb2d33f9 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.165078 Aug 10 17:05:37.552782 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 614/1245] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:37 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:38.574953 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:38.575565 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:38.581963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:38.582435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:38.582856 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:38.583535 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:38.583979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:38.584426 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:38.723617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:38.731850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:38.733442 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:38.735253 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f3221aa4-c9d2-425f-86c7-5f8c208550f4 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.164206 Aug 10 17:05:38.736049 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 632/1246] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:38 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:39.758071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:39.758707 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:39.766045 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:39.766599 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:39.767032 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:39.767718 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:39.768187 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:39.768613 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:39.902156 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:39.910350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:39.911830 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:39.913009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-55d965bd-f6e1-4671-8597-af23750454ed tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.158784 Aug 10 17:05:39.913562 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 615/1247] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:39 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:40.936674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:40.937469 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:40.943984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:40.944499 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:40.945086 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:40.945616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:40.946303 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:40.946784 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:41.097880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:41.106177 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:41.107668 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:41.108979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ff098563-b6a5-4630-9a9b-80109f8f6d5f tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.176279 Aug 10 17:05:41.111866 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 633/1248] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:40 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:42.132118 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:42.132771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:42.139165 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:42.139644 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:42.140630 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:42.141317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:42.141766 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:42.142187 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:42.270858 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:42.278750 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:42.280313 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:42.282085 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-98ad7ad1-6c69-4cb5-bfe9-dd17952d56ca tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.153920 Aug 10 17:05:42.282643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 616/1249] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:42 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:43.311374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:43.312003 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:43.318991 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:43.319710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:43.320305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:43.321024 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:43.321470 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:43.321897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:43.454998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:43.463072 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:43.464597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:43.466025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5db5f3dc-c958-4775-96a2-a5525bc44505 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.158523 Aug 10 17:05:43.466662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 634/1250] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:43 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:44.490323 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:44.490924 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:44.497335 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:44.497816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:44.498245 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:44.498931 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:44.499380 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:44.500426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:44.624079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:44.632397 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:44.633912 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:44.635048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-78b99ba6-b861-4417-a890-0ba40ac56cb3 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.148665 Aug 10 17:05:44.635598 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 617/1251] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:44 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:45.306461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ded429fc-763b-4ae0-b49d-05a00167474b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:45.306984 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ded429fc-763b-4ae0-b49d-05a00167474b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:45.312929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ded429fc-763b-4ae0-b49d-05a00167474b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:45.313418 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ded429fc-763b-4ae0-b49d-05a00167474b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:45.313850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ded429fc-763b-4ae0-b49d-05a00167474b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:45.314548 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ded429fc-763b-4ae0-b49d-05a00167474b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:45.315025 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ded429fc-763b-4ae0-b49d-05a00167474b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:45.315416 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ded429fc-763b-4ae0-b49d-05a00167474b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:45.338786 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ded429fc-763b-4ae0-b49d-05a00167474b tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/ips" status: 200 len: 147 microversion: 2.1 time: 0.170995 Aug 10 17:05:45.343907 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 635/1252] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 10 17:05:45 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/ips => generated 147 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:05:45.657600 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:45.658270 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:45.664518 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:45.664996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:45.665427 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:45.666112 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:45.666562 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:45.666980 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:45.681237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:45.800403 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:45.809678 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:45.811608 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:45.813862 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f33e1abc-8291-40c5-b130-2f61243c89b2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.160253 Aug 10 17:05:45.814435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 618/1253] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:45 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:46.668727 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e7d6a7c9-9742-423c-b118-e14bffd7fc61 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7eba42f-d24a-4fc7-8143-f2634fd16c92"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:05:46.671107 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e7d6a7c9-9742-423c-b118-e14bffd7fc61 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:46.677714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7d6a7c9-9742-423c-b118-e14bffd7fc61 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:46.678199 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7d6a7c9-9742-423c-b118-e14bffd7fc61 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:46.678634 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7d6a7c9-9742-423c-b118-e14bffd7fc61 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:46.679346 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7d6a7c9-9742-423c-b118-e14bffd7fc61 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:46.679796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7d6a7c9-9742-423c-b118-e14bffd7fc61 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:46.680241 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e7d6a7c9-9742-423c-b118-e14bffd7fc61 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:46.837449 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:46.838060 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:46.844973 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:46.845460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:46.845904 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:46.846603 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:46.847067 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:46.847493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:46.977774 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:46.985575 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:46.987074 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:46.988255 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2c13c4d3-5588-4fdb-871a-d97420bd9f85 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.154922 Aug 10 17:05:46.988817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 619/1254] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:46 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:05:47.322838 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e7d6a7c9-9742-423c-b118-e14bffd7fc61 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "POST /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657574 Aug 10 17:05:47.323438 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 636/1255] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 17:05:46 2022] POST /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:05:48.011214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:48.011836 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:48.019074 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:48.019558 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:48.019997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:48.020736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:48.021230 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:48.021807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:48.153984 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:48.162050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:48.163487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:48.164676 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-325d3d9a-d293-48b5-853a-5162429ba53c tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.157427 Aug 10 17:05:48.165234 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 620/1256] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:48 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:49.187365 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:49.188049 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:49.194816 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:49.195296 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:49.195725 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:49.196437 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:49.196886 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:49.197302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:49.201317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:49.329197 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:49.337217 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:49.338711 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:49.339860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8329beda-df49-41b9-a8f9-6871761a89ba tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.156767 Aug 10 17:05:49.340452 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 637/1257] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:49 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:49.669675 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9cf92109-47e4-46a6-b9d3-9b16cef751f9 req-4502097f-a389-4595-bb86-167bbceedc7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55af62cb-d5be-4fef-b179-39240d0b13cb", "name": "network-vif-plugged", "status": "completed", "tag": "228e4301-98ff-4548-915d-d44107e8a96d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:05:49.679794 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9cf92109-47e4-46a6-b9d3-9b16cef751f9 req-4502097f-a389-4595-bb86-167bbceedc7b service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:49.680303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9cf92109-47e4-46a6-b9d3-9b16cef751f9 req-4502097f-a389-4595-bb86-167bbceedc7b service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:49.680738 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9cf92109-47e4-46a6-b9d3-9b16cef751f9 req-4502097f-a389-4595-bb86-167bbceedc7b service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:49.695303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9cf92109-47e4-46a6-b9d3-9b16cef751f9 req-4502097f-a389-4595-bb86-167bbceedc7b service nova] Creating event network-vif-plugged:228e4301-98ff-4548-915d-d44107e8a96d for instance 55af62cb-d5be-4fef-b179-39240d0b13cb on hv-cinder-83602 Aug 10 17:05:49.700395 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9cf92109-47e4-46a6-b9d3-9b16cef751f9 req-4502097f-a389-4595-bb86-167bbceedc7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095734 Aug 10 17:05:49.701003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 621/1258] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:05:50.363549 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:50.364171 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:50.370528 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:50.371010 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:50.371442 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:50.372125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:50.372601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:50.373023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:50.500631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:50.508551 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:50.510044 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:50.511187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e78212f7-be59-402c-be6a-eeb9ca433c96 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.151950 Aug 10 17:05:50.511743 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 638/1259] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:50 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:51.534659 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:51.535322 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:51.541496 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:51.541975 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:51.542428 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:51.543092 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:51.543542 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:51.543960 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:51.679032 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:51.687408 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:51.689209 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:51.690840 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0bb1253-d725-47f2-902d-df679b70c4fe tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1730 microversion: 2.20 time: 0.160702 Aug 10 17:05:51.698230 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 622/1260] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:51 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:52.713870 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:52.714478 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:52.720799 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:52.721282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:52.721726 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:52.722439 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:52.722891 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:52.723311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:52.850153 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:52.858159 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:52.859639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:05:52.861296 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7ab1dcf1-e110-4194-baeb-fc71c6ab8830 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1717 microversion: 2.20 time: 0.151546 Aug 10 17:05:52.861847 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 639/1261] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:05:52 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:05:54.859510 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7954708-a190-4f2e-81f4-7d6e073cc125 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:54.863670 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f7954708-a190-4f2e-81f4-7d6e073cc125 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:54.866831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=34 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:54.872581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7954708-a190-4f2e-81f4-7d6e073cc125 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:54.873235 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7954708-a190-4f2e-81f4-7d6e073cc125 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:54.873879 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7954708-a190-4f2e-81f4-7d6e073cc125 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:54.874908 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7954708-a190-4f2e-81f4-7d6e073cc125 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:54.875695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7954708-a190-4f2e-81f4-7d6e073cc125 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:54.876223 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7954708-a190-4f2e-81f4-7d6e073cc125 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:54.913444 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7954708-a190-4f2e-81f4-7d6e073cc125 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060390 Aug 10 17:05:54.914290 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 623/1262] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:05:54 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:05:54.928419 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-78193795-f887-4b8f-90fc-281a19947510 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:54.928961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-78193795-f887-4b8f-90fc-281a19947510 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:54.935902 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78193795-f887-4b8f-90fc-281a19947510 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:54.936425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78193795-f887-4b8f-90fc-281a19947510 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:54.936859 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78193795-f887-4b8f-90fc-281a19947510 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:54.937631 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78193795-f887-4b8f-90fc-281a19947510 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:54.938099 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78193795-f887-4b8f-90fc-281a19947510 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:54.939389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78193795-f887-4b8f-90fc-281a19947510 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:54.969813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-78193795-f887-4b8f-90fc-281a19947510 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments/c7eba42f-d24a-4fc7-8143-f2634fd16c92" status: 200 len: 194 microversion: 2.1 time: 0.046548 Aug 10 17:05:54.970397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 640/1263] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Aug 10 17:05:54 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments/c7eba42f-d24a-4fc7-8143-f2634fd16c92 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:05:56.299805 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-077d62bd-dca4-4c18-85db-9e57691650f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b45170e-e7cc-4875-8b86-8dc63d0c155f"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:05:56.302238 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-077d62bd-dca4-4c18-85db-9e57691650f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:05:56.308653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077d62bd-dca4-4c18-85db-9e57691650f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:56.309142 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077d62bd-dca4-4c18-85db-9e57691650f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:56.309581 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077d62bd-dca4-4c18-85db-9e57691650f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:56.310278 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077d62bd-dca4-4c18-85db-9e57691650f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:56.310732 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077d62bd-dca4-4c18-85db-9e57691650f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:56.311159 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-077d62bd-dca4-4c18-85db-9e57691650f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:56.583543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-077d62bd-dca4-4c18-85db-9e57691650f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "POST /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288391 Aug 10 17:05:56.584224 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 624/1264] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 17:05:56 2022] POST /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:04.105120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b4195860-f9bb-4b01-87c3-95d297911484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:04.107431 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b4195860-f9bb-4b01-87c3-95d297911484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:04.109871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=22 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:04.115572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4195860-f9bb-4b01-87c3-95d297911484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:04.116050 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4195860-f9bb-4b01-87c3-95d297911484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:04.116519 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4195860-f9bb-4b01-87c3-95d297911484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:04.117206 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4195860-f9bb-4b01-87c3-95d297911484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:04.117654 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4195860-f9bb-4b01-87c3-95d297911484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:04.118072 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4195860-f9bb-4b01-87c3-95d297911484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:04.147374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b4195860-f9bb-4b01-87c3-95d297911484 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046194 Aug 10 17:06:04.147912 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 641/1265] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:06:04 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:04.285732 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8e0e736-8dc2-4fcb-baa7-59a86575e01f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:04.286254 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a8e0e736-8dc2-4fcb-baa7-59a86575e01f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:04.292369 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e0e736-8dc2-4fcb-baa7-59a86575e01f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:04.292846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e0e736-8dc2-4fcb-baa7-59a86575e01f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:04.293304 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e0e736-8dc2-4fcb-baa7-59a86575e01f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:04.294073 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e0e736-8dc2-4fcb-baa7-59a86575e01f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:04.294551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e0e736-8dc2-4fcb-baa7-59a86575e01f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:04.294971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e0e736-8dc2-4fcb-baa7-59a86575e01f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:04.322974 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8e0e736-8dc2-4fcb-baa7-59a86575e01f tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments/c7eba42f-d24a-4fc7-8143-f2634fd16c92" status: 200 len: 194 microversion: 2.1 time: 0.042834 Aug 10 17:06:04.323543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 625/1266] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Aug 10 17:06:04 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments/c7eba42f-d24a-4fc7-8143-f2634fd16c92 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:04.333805 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fb5f59b6-e23a-4344-89a0-d90ff5c97ceb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:04.334360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fb5f59b6-e23a-4344-89a0-d90ff5c97ceb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:04.340782 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb5f59b6-e23a-4344-89a0-d90ff5c97ceb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:04.341277 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb5f59b6-e23a-4344-89a0-d90ff5c97ceb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:04.341718 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb5f59b6-e23a-4344-89a0-d90ff5c97ceb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:04.342425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb5f59b6-e23a-4344-89a0-d90ff5c97ceb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:04.342914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb5f59b6-e23a-4344-89a0-d90ff5c97ceb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:04.343339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fb5f59b6-e23a-4344-89a0-d90ff5c97ceb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:04.424065 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-fb5f59b6-e23a-4344-89a0-d90ff5c97ceb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lazy-loading 'services' on Instance uuid df8b8fdf-5e32-44fc-9b45-6e7a634d909c {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:06:04.493885 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fb5f59b6-e23a-4344-89a0-d90ff5c97ceb tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments/c7eba42f-d24a-4fc7-8143-f2634fd16c92" status: 202 len: 0 microversion: 2.1 time: 0.163774 Aug 10 17:06:04.494478 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 642/1267] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 17:06:04 2022] DELETE /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments/c7eba42f-d24a-4fc7-8143-f2634fd16c92 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:06:06.672477 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4af2a5b-02c0-4260-add8-b888265563b1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:06.673025 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4af2a5b-02c0-4260-add8-b888265563b1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:06.680375 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af2a5b-02c0-4260-add8-b888265563b1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:06.680866 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af2a5b-02c0-4260-add8-b888265563b1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:06.681308 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af2a5b-02c0-4260-add8-b888265563b1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:06.682003 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af2a5b-02c0-4260-add8-b888265563b1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:06.682459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af2a5b-02c0-4260-add8-b888265563b1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:06.682885 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4af2a5b-02c0-4260-add8-b888265563b1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:06.710603 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4af2a5b-02c0-4260-add8-b888265563b1 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments/8b45170e-e7cc-4875-8b86-8dc63d0c155f" status: 200 len: 194 microversion: 2.1 time: 0.042047 Aug 10 17:06:06.711180 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 626/1268] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Aug 10 17:06:06 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments/8b45170e-e7cc-4875-8b86-8dc63d0c155f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:06.722974 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b7c7348d-be37-482b-810c-bfd5799493e9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:06.723583 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b7c7348d-be37-482b-810c-bfd5799493e9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:06.729589 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7c7348d-be37-482b-810c-bfd5799493e9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:06.730070 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7c7348d-be37-482b-810c-bfd5799493e9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:06.730504 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7c7348d-be37-482b-810c-bfd5799493e9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:06.731218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7c7348d-be37-482b-810c-bfd5799493e9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:06.731670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7c7348d-be37-482b-810c-bfd5799493e9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:06.732093 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7c7348d-be37-482b-810c-bfd5799493e9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:06.809809 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-b7c7348d-be37-482b-810c-bfd5799493e9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lazy-loading 'services' on Instance uuid df8b8fdf-5e32-44fc-9b45-6e7a634d909c {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:06:06.879161 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b7c7348d-be37-482b-810c-bfd5799493e9 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments/8b45170e-e7cc-4875-8b86-8dc63d0c155f" status: 202 len: 0 microversion: 2.1 time: 0.161214 Aug 10 17:06:06.879739 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 643/1269] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 17:06:06 2022] DELETE /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments/8b45170e-e7cc-4875-8b86-8dc63d0c155f => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:06:08.067702 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6efd1499-1972-4d5e-a4d5-5dbeab2735c7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:08.069994 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6efd1499-1972-4d5e-a4d5-5dbeab2735c7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:08.076362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6efd1499-1972-4d5e-a4d5-5dbeab2735c7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:08.076846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6efd1499-1972-4d5e-a4d5-5dbeab2735c7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:08.077284 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6efd1499-1972-4d5e-a4d5-5dbeab2735c7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:08.078000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6efd1499-1972-4d5e-a4d5-5dbeab2735c7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:08.078453 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6efd1499-1972-4d5e-a4d5-5dbeab2735c7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:08.078876 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6efd1499-1972-4d5e-a4d5-5dbeab2735c7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:08.107695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6efd1499-1972-4d5e-a4d5-5dbeab2735c7 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043925 Aug 10 17:06:08.108281 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 627/1270] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:06:08 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:06:08.218545 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-48ab1a87-c47b-48b1-8ca6-ab32bcd7d22d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:08.220821 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-48ab1a87-c47b-48b1-8ca6-ab32bcd7d22d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:08.227239 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48ab1a87-c47b-48b1-8ca6-ab32bcd7d22d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:08.227715 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48ab1a87-c47b-48b1-8ca6-ab32bcd7d22d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:08.228176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48ab1a87-c47b-48b1-8ca6-ab32bcd7d22d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:08.228868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48ab1a87-c47b-48b1-8ca6-ab32bcd7d22d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:08.229317 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48ab1a87-c47b-48b1-8ca6-ab32bcd7d22d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:08.229735 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48ab1a87-c47b-48b1-8ca6-ab32bcd7d22d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:08.257924 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-48ab1a87-c47b-48b1-8ca6-ab32bcd7d22d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044437 Aug 10 17:06:08.258467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 644/1271] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:06:08 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:06:08.319340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2b3a8a00-0e34-494e-8539-c7188e457a76 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:08.320077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2b3a8a00-0e34-494e-8539-c7188e457a76 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:08.328568 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a00-0e34-494e-8539-c7188e457a76 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:08.329085 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a00-0e34-494e-8539-c7188e457a76 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:08.329548 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a00-0e34-494e-8539-c7188e457a76 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:08.330246 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a00-0e34-494e-8539-c7188e457a76 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:08.331188 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a00-0e34-494e-8539-c7188e457a76 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:08.331612 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a00-0e34-494e-8539-c7188e457a76 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:08.356226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2b3a8a00-0e34-494e-8539-c7188e457a76 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:06:08.433958 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2b3a8a00-0e34-494e-8539-c7188e457a76 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 204 len: 0 microversion: 2.1 time: 0.118969 Aug 10 17:06:08.434675 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 628/1272] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:06:08 2022] DELETE /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:06:08.444197 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9e2f4cbd-5096-4b7c-9811-26fc9cef396e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:08.444807 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9e2f4cbd-5096-4b7c-9811-26fc9cef396e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:08.450636 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e2f4cbd-5096-4b7c-9811-26fc9cef396e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:08.451114 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e2f4cbd-5096-4b7c-9811-26fc9cef396e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:08.451544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e2f4cbd-5096-4b7c-9811-26fc9cef396e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:08.452254 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e2f4cbd-5096-4b7c-9811-26fc9cef396e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:08.452703 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e2f4cbd-5096-4b7c-9811-26fc9cef396e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:08.453259 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e2f4cbd-5096-4b7c-9811-26fc9cef396e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:08.582115 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9e2f4cbd-5096-4b7c-9811-26fc9cef396e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:08.589775 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9e2f4cbd-5096-4b7c-9811-26fc9cef396e tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1674 microversion: 2.1 time: 0.149959 Aug 10 17:06:08.590335 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 645/1273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:08 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:06:09.611420 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de2b4788-89ea-4789-9c33-057c3715e681 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:09.612656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-de2b4788-89ea-4789-9c33-057c3715e681 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:09.618939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de2b4788-89ea-4789-9c33-057c3715e681 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:09.619423 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de2b4788-89ea-4789-9c33-057c3715e681 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:09.619890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de2b4788-89ea-4789-9c33-057c3715e681 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:09.620602 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de2b4788-89ea-4789-9c33-057c3715e681 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:09.621056 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de2b4788-89ea-4789-9c33-057c3715e681 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:09.621480 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de2b4788-89ea-4789-9c33-057c3715e681 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:09.758831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-de2b4788-89ea-4789-9c33-057c3715e681 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:09.766302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-de2b4788-89ea-4789-9c33-057c3715e681 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1674 microversion: 2.1 time: 0.159147 Aug 10 17:06:09.766870 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 629/1274] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:09 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:10.787730 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7f28e1f5-db78-48cc-8982-5d44ce2b72f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:10.788369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7f28e1f5-db78-48cc-8982-5d44ce2b72f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:10.795074 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f28e1f5-db78-48cc-8982-5d44ce2b72f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:10.795556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f28e1f5-db78-48cc-8982-5d44ce2b72f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:10.795988 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f28e1f5-db78-48cc-8982-5d44ce2b72f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:10.796852 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f28e1f5-db78-48cc-8982-5d44ce2b72f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:10.797321 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f28e1f5-db78-48cc-8982-5d44ce2b72f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:10.797747 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f28e1f5-db78-48cc-8982-5d44ce2b72f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:11.026128 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7f28e1f5-db78-48cc-8982-5d44ce2b72f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:11.035145 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7f28e1f5-db78-48cc-8982-5d44ce2b72f8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1674 microversion: 2.1 time: 0.251276 Aug 10 17:06:11.035726 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 646/1275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:10 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1674 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:11.659809 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9dee36fa-379e-4246-aa39-80b9dd4f11d2 req-40ae8d92-5804-4ca1-91d9-371ab90a608e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8b8fdf-5e32-44fc-9b45-6e7a634d909c", "name": "network-vif-deleted", "tag": "a2912711-1309-49e8-8095-321960439307"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:06:11.670813 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9dee36fa-379e-4246-aa39-80b9dd4f11d2 req-40ae8d92-5804-4ca1-91d9-371ab90a608e service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:11.671593 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9dee36fa-379e-4246-aa39-80b9dd4f11d2 req-40ae8d92-5804-4ca1-91d9-371ab90a608e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:11.672047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9dee36fa-379e-4246-aa39-80b9dd4f11d2 req-40ae8d92-5804-4ca1-91d9-371ab90a608e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:11.685356 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9dee36fa-379e-4246-aa39-80b9dd4f11d2 req-40ae8d92-5804-4ca1-91d9-371ab90a608e service nova] Creating event network-vif-deleted:a2912711-1309-49e8-8095-321960439307 for instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c on hv-cinder-83602 Aug 10 17:06:11.691289 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9dee36fa-379e-4246-aa39-80b9dd4f11d2 req-40ae8d92-5804-4ca1-91d9-371ab90a608e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034934 Aug 10 17:06:11.692350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 630/1276] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:12.058879 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:12.059486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:12.067089 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:12.067570 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:12.067997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:12.068727 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:12.069172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:12.070327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:12.116077 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:12.116497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:12.116924 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:12.117367 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lazy-loading 'fault' on Instance uuid df8b8fdf-5e32-44fc-9b45-6e7a634d909c {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:06:12.158600 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b8847d10744ec98e0ed7a3f1e991ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11dfd80b6c544f6b87a58d5a25c5649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:12.166123 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fd1a61a6-32a4-4a6e-bb01-4845c22c8b09 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 200 len: 1327 microversion: 2.1 time: 0.113159 Aug 10 17:06:12.166692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 647/1277] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:12 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:13.188752 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:13.189477 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:13.195459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:13.195941 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:13.196403 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:13.197094 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:13.197550 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:13.197975 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:13.211176 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] HTTP exception thrown: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Request method failure captured: Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c HTTP/1.1 Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lzvi5Y9WNdbMyOQTzBnMNK8qJj8ppZXYItuHXJUyx4ludzIbx2ahcxIbTxRgTLsHeeC1T7BjR3BVnB4UnQy1Tddxccthhqc71F7IKh8JCs6wkEKQi-4NQl5jG8_Hef3W508KJtvUnsAZh_H0zaCbGdbXVJI90339SwZdwdSEyvM_g Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:06:13.212792 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c11dfd80b6c544f6b87a58d5a25c5649", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 77b8847d10744ec98e0ed7a3f1e991ed Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:13.214441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': 'df8b8fdf-5e32-44fc-9b45-6e7a634d909c'} Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:13.215393 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:13.216997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:13.218433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Returning 404 to user: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:13.218433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c114fce9-3f78-4366-a14f-a62f5f683b7d tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 404 len: 111 microversion: 2.1 time: 0.030096 Aug 10 17:06:13.218433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 631/1278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:13 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:13.223839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3e8873b7-b5fb-482e-ae3b-f362207ecf19 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '.version_select at 0x7f5b08481dc0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:13.243867 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3e8873b7-b5fb-482e-ae3b-f362207ecf19 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631067838" status: 202 len: 0 microversion: 2.1 time: 0.024709 Aug 10 17:06:13.244572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 648/1279] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Aug 10 17:06:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631067838 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:06:19.281842 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:19.282460 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:19.288888 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:19.289365 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:19.289796 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:19.290480 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:19.290926 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:19.291346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:19.293959 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:19.306385 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] HTTP exception thrown: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Request method failure captured: Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c HTTP/1.1 Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lzvi5Y9WNdbMyOQTzBnMNK8qJj8ppZXYItuHXJUyx4ludzIbx2ahcxIbTxRgTLsHeeC1T7BjR3BVnB4UnQy1Tddxccthhqc71F7IKh8JCs6wkEKQi-4NQl5jG8_Hef3W508KJtvUnsAZh_H0zaCbGdbXVJI90339SwZdwdSEyvM_g Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:06:19.307902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c11dfd80b6c544f6b87a58d5a25c5649", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 77b8847d10744ec98e0ed7a3f1e991ed Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:19.309537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': 'df8b8fdf-5e32-44fc-9b45-6e7a634d909c'} Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:19.310438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:19.312087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:19.313925 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Returning 404 to user: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:19.313925 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-773977b7-706e-430b-a03e-3c8bcddc355a tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 404 len: 111 microversion: 2.1 time: 0.031304 Aug 10 17:06:19.313925 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 632/1280] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:06:19 2022] DELETE /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:19.319557 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:19.320172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: df8b8fdf-5e32-44fc-9b45-6e7a634d909c] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:19.326305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:19.326784 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:19.327217 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:19.327897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:19.328370 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:19.328805 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:19.331356 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:19.345045 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] HTTP exception thrown: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Request method failure captured: Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c HTTP/1.1 Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lzvi5Y9WNdbMyOQTzBnMNK8qJj8ppZXYItuHXJUyx4ludzIbx2ahcxIbTxRgTLsHeeC1T7BjR3BVnB4UnQy1Tddxccthhqc71F7IKh8JCs6wkEKQi-4NQl5jG8_Hef3W508KJtvUnsAZh_H0zaCbGdbXVJI90339SwZdwdSEyvM_g Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:06:19.346663 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c11dfd80b6c544f6b87a58d5a25c5649", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 77b8847d10744ec98e0ed7a3f1e991ed Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:19.348323 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'df8b8fdf-5e32-44fc-9b45-6e7a634d909c'} Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:19.349218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. Aug 10 17:06:19.350683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:19.351952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Returning 404 to user: Instance df8b8fdf-5e32-44fc-9b45-6e7a634d909c could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:19.351952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9b59bea8-9026-4b79-befe-367a061a07ec tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c" status: 404 len: 111 microversion: 2.1 time: 0.033571 Aug 10 17:06:19.351952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 649/1281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:19 2022] GET /compute/v2.1/servers/df8b8fdf-5e32-44fc-9b45-6e7a634d909c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:20.484902 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:20.485406 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:20.492083 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:20.492603 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:20.493046 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:20.493738 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:20.494197 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:20.494629 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:20.507791 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] HTTP exception thrown: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Request method failure captured: Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 HTTP/1.1 Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lzvi5Y9WNdbMyOQTzBnMNK8qJj8ppZXYItuHXJUyx4ludzIbx2ahcxIbTxRgTLsHeeC1T7BjR3BVnB4UnQy1Tddxccthhqc71F7IKh8JCs6wkEKQi-4NQl5jG8_Hef3W508KJtvUnsAZh_H0zaCbGdbXVJI90339SwZdwdSEyvM_g Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:06:20.509346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c11dfd80b6c544f6b87a58d5a25c5649", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 77b8847d10744ec98e0ed7a3f1e991ed Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:06:20.510985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '2a08fd38-1ced-4301-a089-e789299f3104'} Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:20.511847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:06:20.513373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:20.514799 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Returning 404 to user: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:20.514799 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-74f35260-854e-4c50-be8f-55bdac3a5ab8 tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 404 len: 111 microversion: 2.1 time: 0.029624 Aug 10 17:06:20.514799 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 633/1282] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:06:20 2022] DELETE /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:20.519171 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:20.519788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] [instance: 2a08fd38-1ced-4301-a089-e789299f3104] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:20.527027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:20.527456 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:20.527896 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:20.528694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:20.529152 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:20.529582 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:20.543555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] HTTP exception thrown: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Request method failure captured: Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 HTTP/1.1 Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lzvi5Y9WNdbMyOQTzBnMNK8qJj8ppZXYItuHXJUyx4ludzIbx2ahcxIbTxRgTLsHeeC1T7BjR3BVnB4UnQy1Tddxccthhqc71F7IKh8JCs6wkEKQi-4NQl5jG8_Hef3W508KJtvUnsAZh_H0zaCbGdbXVJI90339SwZdwdSEyvM_g Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:06:20.545105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c11dfd80b6c544f6b87a58d5a25c5649", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c11dfd80b6c544f6b87a58d5a25c5649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: c11dfd80b6c544f6b87a58d5a25c5649 Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062915657 Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 77b8847d10744ec98e0ed7a3f1e991ed Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeTestJSON-1062915657-project Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:06:20.546716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '2a08fd38-1ced-4301-a089-e789299f3104'} Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:20.547643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. Aug 10 17:06:20.549122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:20.550676 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] Returning 404 to user: Instance 2a08fd38-1ced-4301-a089-e789299f3104 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:20.550676 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a64161d3-ca22-43c9-819f-6eea9ebb76ea tempest-AttachVolumeTestJSON-1062915657 tempest-AttachVolumeTestJSON-1062915657-project] 10.222.0.25 "GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104" status: 404 len: 111 microversion: 2.1 time: 0.031273 Aug 10 17:06:20.550676 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 650/1283] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:20 2022] GET /compute/v2.1/servers/2a08fd38-1ced-4301-a089-e789299f3104 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:26.527019 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-307778190", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-465937417", "security_groups": [{"name": "tempest-secgroup-smoke-1125656476"}], "block_device_mapping_v2": [{"uuid": "ddd2a4a2-b8f2-482d-8d44-18f98af0ce6e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f5066015-605a-4fe4-890b-df73669544bb"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:06:26.536876 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:26.665344 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] validate_networks() for [('f5066015-605a-4fe4-890b-df73669544bb', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:06:27.080734 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:06:27.081185 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:06:27.081655 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:06:27.082055 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:06:27.083187 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:06:27.091976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:27.092485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:27.092914 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:27.093627 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:27.094266 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:27.094686 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:27.111550 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Getting quotas for project 41311d9aa3f54596a61033b0ea82ba80. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:06:27.115464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Getting quotas for user a1c78f05a0f24151a1884faed65d286e and project 41311d9aa3f54596a61033b0ea82ba80. Resources: {'ram', 'cores', 'instances'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:06:27.178070 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:06:27.180469 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddd2a4a2-b8f2-482d-8d44-18f98af0ce6e',volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:06:27.323340 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d1a3c853-e9e4-48ab-92bc-c2a9473f138f tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.800047 Aug 10 17:06:27.324354 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 634/1284] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 17:06:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:06:27.335685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-47a02f0a-aac6-455e-bb3a-cbc48c8590f4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:27.336659 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-47a02f0a-aac6-455e-bb3a-cbc48c8590f4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:27.393216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-47a02f0a-aac6-455e-bb3a-cbc48c8590f4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:27.400599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-47a02f0a-aac6-455e-bb3a-cbc48c8590f4 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1093 microversion: 2.1 time: 0.069562 Aug 10 17:06:27.401160 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 651/1285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:27 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:28.421895 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f09bc82-c384-4d0f-9928-2214a5e882a2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:28.422513 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8f09bc82-c384-4d0f-9928-2214a5e882a2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:28.436280 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f09bc82-c384-4d0f-9928-2214a5e882a2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:28.436789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f09bc82-c384-4d0f-9928-2214a5e882a2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:28.437264 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f09bc82-c384-4d0f-9928-2214a5e882a2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:28.438229 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f09bc82-c384-4d0f-9928-2214a5e882a2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:28.438692 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f09bc82-c384-4d0f-9928-2214a5e882a2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:28.439125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f09bc82-c384-4d0f-9928-2214a5e882a2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:28.515198 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8f09bc82-c384-4d0f-9928-2214a5e882a2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:28.529237 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8f09bc82-c384-4d0f-9928-2214a5e882a2 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1191 microversion: 2.1 time: 0.111617 Aug 10 17:06:28.529880 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 635/1286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:28 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1191 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:29.228126 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-77aba6a4-b73c-41b9-8d21-7f353636890c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:29.228675 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-77aba6a4-b73c-41b9-8d21-7f353636890c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:29.236366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77aba6a4-b73c-41b9-8d21-7f353636890c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:29.236999 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77aba6a4-b73c-41b9-8d21-7f353636890c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:29.237439 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77aba6a4-b73c-41b9-8d21-7f353636890c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:29.238141 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77aba6a4-b73c-41b9-8d21-7f353636890c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:29.239092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77aba6a4-b73c-41b9-8d21-7f353636890c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:29.239546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77aba6a4-b73c-41b9-8d21-7f353636890c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:29.265813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-77aba6a4-b73c-41b9-8d21-7f353636890c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/ips" status: 200 len: 149 microversion: 2.1 time: 0.040903 Aug 10 17:06:29.266481 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 652/1287] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Aug 10 17:06:29 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:29.553547 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61573028-f289-45d9-89b0-6c051d76fc1b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:29.554785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-61573028-f289-45d9-89b0-6c051d76fc1b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:29.566500 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61573028-f289-45d9-89b0-6c051d76fc1b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:29.567766 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61573028-f289-45d9-89b0-6c051d76fc1b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:29.569814 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61573028-f289-45d9-89b0-6c051d76fc1b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:29.572221 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61573028-f289-45d9-89b0-6c051d76fc1b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:29.572357 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61573028-f289-45d9-89b0-6c051d76fc1b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:29.572888 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61573028-f289-45d9-89b0-6c051d76fc1b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:29.753203 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-61573028-f289-45d9-89b0-6c051d76fc1b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:29.762053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-61573028-f289-45d9-89b0-6c051d76fc1b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.213751 Aug 10 17:06:29.762861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 636/1288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:29 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:30.272641 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-d8157709-c77b-4dfd-acbd-1f778822cca4 req-c4e84dae-e6e8-484b-9f13-c45d09f6165f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f6d6951-ebd9-41fb-b41f-86b68db6ae68", "tag": "c2cb00cb-2858-4fe5-9e7a-7be0435be386"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:06:30.283222 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d8157709-c77b-4dfd-acbd-1f778822cca4 req-c4e84dae-e6e8-484b-9f13-c45d09f6165f service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:30.283796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d8157709-c77b-4dfd-acbd-1f778822cca4 req-c4e84dae-e6e8-484b-9f13-c45d09f6165f service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:30.284335 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d8157709-c77b-4dfd-acbd-1f778822cca4 req-c4e84dae-e6e8-484b-9f13-c45d09f6165f service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:30.295972 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-d8157709-c77b-4dfd-acbd-1f778822cca4 req-c4e84dae-e6e8-484b-9f13-c45d09f6165f service nova] Creating event network-changed:c2cb00cb-2858-4fe5-9e7a-7be0435be386 for instance 0f6d6951-ebd9-41fb-b41f-86b68db6ae68 on hv-cinder-83602 Aug 10 17:06:30.301016 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-d8157709-c77b-4dfd-acbd-1f778822cca4 req-c4e84dae-e6e8-484b-9f13-c45d09f6165f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032637 Aug 10 17:06:30.301598 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 653/1289] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:30.672413 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a94a40ed-96e4-4880-88fd-d6dd6b75a412 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "809bbeff-6982-4e52-a4f0-8a83e1bc3534"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:06:30.674844 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a94a40ed-96e4-4880-88fd-d6dd6b75a412 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:30.681912 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a94a40ed-96e4-4880-88fd-d6dd6b75a412 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:30.682394 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a94a40ed-96e4-4880-88fd-d6dd6b75a412 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:30.682826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a94a40ed-96e4-4880-88fd-d6dd6b75a412 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:30.683512 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a94a40ed-96e4-4880-88fd-d6dd6b75a412 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:30.683961 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a94a40ed-96e4-4880-88fd-d6dd6b75a412 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:30.684413 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a94a40ed-96e4-4880-88fd-d6dd6b75a412 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:30.784339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f86a9701-3252-43ca-aa83-fde5bcc46e6a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:30.784973 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f86a9701-3252-43ca-aa83-fde5bcc46e6a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:30.791200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f86a9701-3252-43ca-aa83-fde5bcc46e6a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:30.791684 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f86a9701-3252-43ca-aa83-fde5bcc46e6a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:30.792172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f86a9701-3252-43ca-aa83-fde5bcc46e6a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:30.792855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f86a9701-3252-43ca-aa83-fde5bcc46e6a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:30.793348 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f86a9701-3252-43ca-aa83-fde5bcc46e6a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:30.793767 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f86a9701-3252-43ca-aa83-fde5bcc46e6a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:30.925150 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f86a9701-3252-43ca-aa83-fde5bcc46e6a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:30.932958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f86a9701-3252-43ca-aa83-fde5bcc46e6a tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.152989 Aug 10 17:06:30.933520 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 654/1290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:30 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:06:31.953956 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c44934b2-03f7-439e-bb3c-0db7d73d01d6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:31.954610 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c44934b2-03f7-439e-bb3c-0db7d73d01d6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:31.961968 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c44934b2-03f7-439e-bb3c-0db7d73d01d6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:31.962485 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c44934b2-03f7-439e-bb3c-0db7d73d01d6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:31.962918 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c44934b2-03f7-439e-bb3c-0db7d73d01d6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:31.963608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c44934b2-03f7-439e-bb3c-0db7d73d01d6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:31.964059 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c44934b2-03f7-439e-bb3c-0db7d73d01d6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:31.964520 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c44934b2-03f7-439e-bb3c-0db7d73d01d6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:32.090870 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c44934b2-03f7-439e-bb3c-0db7d73d01d6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:32.099193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c44934b2-03f7-439e-bb3c-0db7d73d01d6 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.149071 Aug 10 17:06:32.099853 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 655/1291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:31 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:06:32.595768 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a94a40ed-96e4-4880-88fd-d6dd6b75a412 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "POST /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.927210 Aug 10 17:06:32.596316 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 637/1292] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 17:06:30 2022] POST /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/os-volume_attachments => generated 194 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:06:33.120235 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-616b5f98-69c3-4906-839d-44567b0d1d74 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:33.120772 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-616b5f98-69c3-4906-839d-44567b0d1d74 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:33.127008 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-616b5f98-69c3-4906-839d-44567b0d1d74 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:33.127481 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-616b5f98-69c3-4906-839d-44567b0d1d74 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:33.127906 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-616b5f98-69c3-4906-839d-44567b0d1d74 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:33.128614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-616b5f98-69c3-4906-839d-44567b0d1d74 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:33.129061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-616b5f98-69c3-4906-839d-44567b0d1d74 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:33.129480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-616b5f98-69c3-4906-839d-44567b0d1d74 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:33.261949 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-616b5f98-69c3-4906-839d-44567b0d1d74 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:33.269486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-616b5f98-69c3-4906-839d-44567b0d1d74 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.153216 Aug 10 17:06:33.270551 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 656/1293] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:33 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:34.291462 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79a1f85f-c5af-4e4b-924b-c2883076290d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:34.292197 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-79a1f85f-c5af-4e4b-924b-c2883076290d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:34.298831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a1f85f-c5af-4e4b-924b-c2883076290d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:34.299316 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a1f85f-c5af-4e4b-924b-c2883076290d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:34.299755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a1f85f-c5af-4e4b-924b-c2883076290d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:34.300481 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a1f85f-c5af-4e4b-924b-c2883076290d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:34.300941 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a1f85f-c5af-4e4b-924b-c2883076290d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:34.301980 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a1f85f-c5af-4e4b-924b-c2883076290d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:34.437764 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-79a1f85f-c5af-4e4b-924b-c2883076290d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:34.445214 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79a1f85f-c5af-4e4b-924b-c2883076290d tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.157962 Aug 10 17:06:34.445781 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 638/1294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:34 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:35.465546 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d172439f-0f67-4306-b83e-713a9fa0fa54 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:35.466094 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d172439f-0f67-4306-b83e-713a9fa0fa54 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:35.468503 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:35.473734 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d172439f-0f67-4306-b83e-713a9fa0fa54 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:35.474218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d172439f-0f67-4306-b83e-713a9fa0fa54 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:35.474651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d172439f-0f67-4306-b83e-713a9fa0fa54 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:35.475340 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d172439f-0f67-4306-b83e-713a9fa0fa54 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:35.475789 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d172439f-0f67-4306-b83e-713a9fa0fa54 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:35.476245 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d172439f-0f67-4306-b83e-713a9fa0fa54 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:35.607425 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d172439f-0f67-4306-b83e-713a9fa0fa54 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:35.615453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d172439f-0f67-4306-b83e-713a9fa0fa54 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.153833 Aug 10 17:06:35.616011 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 657/1295] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:35 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:36.635257 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-81595f22-9543-4f01-a81c-077299fc1442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:36.635877 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-81595f22-9543-4f01-a81c-077299fc1442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:36.642149 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81595f22-9543-4f01-a81c-077299fc1442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:36.642629 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81595f22-9543-4f01-a81c-077299fc1442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:36.643058 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81595f22-9543-4f01-a81c-077299fc1442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:36.643741 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81595f22-9543-4f01-a81c-077299fc1442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:36.644211 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81595f22-9543-4f01-a81c-077299fc1442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:36.645264 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81595f22-9543-4f01-a81c-077299fc1442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:36.788130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-81595f22-9543-4f01-a81c-077299fc1442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:36.796219 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-81595f22-9543-4f01-a81c-077299fc1442 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.164779 Aug 10 17:06:36.796786 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 639/1296] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:36 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:37.818854 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f9df7d98-93e5-4f13-8e1b-32aae7c1d596 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:37.819277 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f9df7d98-93e5-4f13-8e1b-32aae7c1d596 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:37.821481 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:37.826538 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9df7d98-93e5-4f13-8e1b-32aae7c1d596 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:37.827028 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9df7d98-93e5-4f13-8e1b-32aae7c1d596 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:37.827704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9df7d98-93e5-4f13-8e1b-32aae7c1d596 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:37.828435 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9df7d98-93e5-4f13-8e1b-32aae7c1d596 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:37.828891 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9df7d98-93e5-4f13-8e1b-32aae7c1d596 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:37.829315 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f9df7d98-93e5-4f13-8e1b-32aae7c1d596 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:37.972581 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f9df7d98-93e5-4f13-8e1b-32aae7c1d596 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:37.981408 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f9df7d98-93e5-4f13-8e1b-32aae7c1d596 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.166772 Aug 10 17:06:37.981970 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 658/1297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:37 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:39.002257 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9bedadf4-88ba-4a52-a26d-c1e28f75533e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:39.002869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9bedadf4-88ba-4a52-a26d-c1e28f75533e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:39.004861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:39.005525 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:39.012047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bedadf4-88ba-4a52-a26d-c1e28f75533e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:39.012571 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bedadf4-88ba-4a52-a26d-c1e28f75533e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:39.013008 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bedadf4-88ba-4a52-a26d-c1e28f75533e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:39.013708 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bedadf4-88ba-4a52-a26d-c1e28f75533e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:39.014163 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bedadf4-88ba-4a52-a26d-c1e28f75533e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:39.014588 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bedadf4-88ba-4a52-a26d-c1e28f75533e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:39.146270 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9bedadf4-88ba-4a52-a26d-c1e28f75533e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:39.153730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9bedadf4-88ba-4a52-a26d-c1e28f75533e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.155317 Aug 10 17:06:39.154292 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 640/1298] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:38 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:40.175020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2acbcf23-7860-40f3-97c2-d3051af7ef2e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:40.175632 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2acbcf23-7860-40f3-97c2-d3051af7ef2e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:40.183017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2acbcf23-7860-40f3-97c2-d3051af7ef2e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:40.183500 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2acbcf23-7860-40f3-97c2-d3051af7ef2e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:40.183931 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2acbcf23-7860-40f3-97c2-d3051af7ef2e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:40.184653 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2acbcf23-7860-40f3-97c2-d3051af7ef2e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:40.185105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2acbcf23-7860-40f3-97c2-d3051af7ef2e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:40.185529 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2acbcf23-7860-40f3-97c2-d3051af7ef2e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:40.249398 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-22303f9a-d4aa-4847-aeb8-13f732ce9509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:40.250008 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-22303f9a-d4aa-4847-aeb8-13f732ce9509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:40.257018 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22303f9a-d4aa-4847-aeb8-13f732ce9509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:40.257521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22303f9a-d4aa-4847-aeb8-13f732ce9509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:40.258158 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22303f9a-d4aa-4847-aeb8-13f732ce9509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:40.258864 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22303f9a-d4aa-4847-aeb8-13f732ce9509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:40.259313 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22303f9a-d4aa-4847-aeb8-13f732ce9509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:40.259796 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22303f9a-d4aa-4847-aeb8-13f732ce9509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:40.329712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2acbcf23-7860-40f3-97c2-d3051af7ef2e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:40.339956 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2acbcf23-7860-40f3-97c2-d3051af7ef2e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.168774 Aug 10 17:06:40.340881 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 659/1299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:40 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:40.344398 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-22303f9a-d4aa-4847-aeb8-13f732ce9509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lazy-loading 'services' on Instance uuid 0fed6781-3a30-42e6-9787-79f2f12b53de {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:06:40.422925 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-22303f9a-d4aa-4847-aeb8-13f732ce9509 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/os-volume_attachments/809bbeff-6982-4e52-a4f0-8a83e1bc3534" status: 202 len: 0 microversion: 2.1 time: 0.177362 Aug 10 17:06:40.423839 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 641/1300] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 17:06:40 2022] DELETE /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/os-volume_attachments/809bbeff-6982-4e52-a4f0-8a83e1bc3534 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:06:40.440337 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-99f4166c-d09f-4655-91c3-9efb0787f646 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:40.443801 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-99f4166c-d09f-4655-91c3-9efb0787f646 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:40.450171 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-99f4166c-d09f-4655-91c3-9efb0787f646 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:40.450668 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-99f4166c-d09f-4655-91c3-9efb0787f646 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:40.451110 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-99f4166c-d09f-4655-91c3-9efb0787f646 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:40.451820 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-99f4166c-d09f-4655-91c3-9efb0787f646 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:40.452306 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-99f4166c-d09f-4655-91c3-9efb0787f646 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:40.452732 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-99f4166c-d09f-4655-91c3-9efb0787f646 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:40.487742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-99f4166c-d09f-4655-91c3-9efb0787f646 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052457 Aug 10 17:06:40.488349 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 660/1301] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:06:40 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:41.362343 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12c2eab0-1e25-4997-8e19-2eb0bafce15e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:41.363071 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12c2eab0-1e25-4997-8e19-2eb0bafce15e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:41.369633 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12c2eab0-1e25-4997-8e19-2eb0bafce15e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:41.370122 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12c2eab0-1e25-4997-8e19-2eb0bafce15e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:41.370541 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12c2eab0-1e25-4997-8e19-2eb0bafce15e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:41.371251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12c2eab0-1e25-4997-8e19-2eb0bafce15e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:41.371728 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12c2eab0-1e25-4997-8e19-2eb0bafce15e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:41.372163 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12c2eab0-1e25-4997-8e19-2eb0bafce15e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:41.500754 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0e972d7b-0953-4435-9854-8884d713e3de tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:41.503924 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0e972d7b-0953-4435-9854-8884d713e3de tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:41.510983 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e972d7b-0953-4435-9854-8884d713e3de tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:41.511468 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e972d7b-0953-4435-9854-8884d713e3de tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:41.512045 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e972d7b-0953-4435-9854-8884d713e3de tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:41.512782 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e972d7b-0953-4435-9854-8884d713e3de tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:41.513235 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e972d7b-0953-4435-9854-8884d713e3de tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:41.513662 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e972d7b-0953-4435-9854-8884d713e3de tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:41.517927 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-12c2eab0-1e25-4997-8e19-2eb0bafce15e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:41.526358 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12c2eab0-1e25-4997-8e19-2eb0bafce15e tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.168659 Aug 10 17:06:41.527075 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 642/1302] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:41 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:41.549218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0e972d7b-0953-4435-9854-8884d713e3de tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052566 Aug 10 17:06:41.549966 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 661/1303] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:06:41 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:06:41.613250 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-463395ff-dd5c-4d0a-9b23-7aa9a9af2240 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:41.613847 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-463395ff-dd5c-4d0a-9b23-7aa9a9af2240 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:41.620616 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463395ff-dd5c-4d0a-9b23-7aa9a9af2240 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:41.621171 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463395ff-dd5c-4d0a-9b23-7aa9a9af2240 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:41.621790 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463395ff-dd5c-4d0a-9b23-7aa9a9af2240 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:41.622543 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463395ff-dd5c-4d0a-9b23-7aa9a9af2240 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:41.623063 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463395ff-dd5c-4d0a-9b23-7aa9a9af2240 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:41.623487 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463395ff-dd5c-4d0a-9b23-7aa9a9af2240 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:41.650493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-463395ff-dd5c-4d0a-9b23-7aa9a9af2240 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:06:41.730585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-463395ff-dd5c-4d0a-9b23-7aa9a9af2240 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 204 len: 0 microversion: 2.1 time: 0.120958 Aug 10 17:06:41.734287 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 643/1304] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:06:41 2022] DELETE /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:06:41.739362 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2b48729b-db71-4142-8930-232a697770e0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:41.740245 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2b48729b-db71-4142-8930-232a697770e0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:41.746855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b48729b-db71-4142-8930-232a697770e0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:41.747352 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b48729b-db71-4142-8930-232a697770e0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:41.747835 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b48729b-db71-4142-8930-232a697770e0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:41.748520 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b48729b-db71-4142-8930-232a697770e0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:41.748974 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b48729b-db71-4142-8930-232a697770e0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:41.749456 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b48729b-db71-4142-8930-232a697770e0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:41.764329 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-96c0d258-0ba7-4a4e-9f54-60b93a25596f req-febc02e2-83cb-41f0-9cf3-a55ca97b380c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6d6951-ebd9-41fb-b41f-86b68db6ae68", "name": "network-vif-plugged", "status": "completed", "tag": "c2cb00cb-2858-4fe5-9e7a-7be0435be386"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:06:41.787351 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-96c0d258-0ba7-4a4e-9f54-60b93a25596f req-febc02e2-83cb-41f0-9cf3-a55ca97b380c service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:41.788678 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-96c0d258-0ba7-4a4e-9f54-60b93a25596f req-febc02e2-83cb-41f0-9cf3-a55ca97b380c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:41.789342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-96c0d258-0ba7-4a4e-9f54-60b93a25596f req-febc02e2-83cb-41f0-9cf3-a55ca97b380c service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:41.801292 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-96c0d258-0ba7-4a4e-9f54-60b93a25596f req-febc02e2-83cb-41f0-9cf3-a55ca97b380c service nova] Creating event network-vif-plugged:c2cb00cb-2858-4fe5-9e7a-7be0435be386 for instance 0f6d6951-ebd9-41fb-b41f-86b68db6ae68 on hv-cinder-83602 Aug 10 17:06:41.811756 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-96c0d258-0ba7-4a4e-9f54-60b93a25596f req-febc02e2-83cb-41f0-9cf3-a55ca97b380c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051571 Aug 10 17:06:41.812509 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 644/1305] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:06:41.897682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2b48729b-db71-4142-8930-232a697770e0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:41.905304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2b48729b-db71-4142-8930-232a697770e0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1681 microversion: 2.1 time: 0.169740 Aug 10 17:06:41.905889 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 662/1306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:41 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:42.549660 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a3927de3-e200-4f88-92b6-2fc8ea002b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:42.550354 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a3927de3-e200-4f88-92b6-2fc8ea002b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:42.556467 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3927de3-e200-4f88-92b6-2fc8ea002b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:42.556964 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3927de3-e200-4f88-92b6-2fc8ea002b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:42.557401 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3927de3-e200-4f88-92b6-2fc8ea002b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:42.558081 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3927de3-e200-4f88-92b6-2fc8ea002b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:42.558532 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3927de3-e200-4f88-92b6-2fc8ea002b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:42.558952 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3927de3-e200-4f88-92b6-2fc8ea002b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:42.695526 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a3927de3-e200-4f88-92b6-2fc8ea002b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:42.702911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a3927de3-e200-4f88-92b6-2fc8ea002b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.157851 Aug 10 17:06:42.703475 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 645/1307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:42 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:42.927359 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-96f75932-0ffb-45aa-851b-744443578250 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:42.927962 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-96f75932-0ffb-45aa-851b-744443578250 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:42.935007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-96f75932-0ffb-45aa-851b-744443578250 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:42.935482 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-96f75932-0ffb-45aa-851b-744443578250 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:42.935908 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-96f75932-0ffb-45aa-851b-744443578250 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:42.936617 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-96f75932-0ffb-45aa-851b-744443578250 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:42.937156 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-96f75932-0ffb-45aa-851b-744443578250 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:42.937482 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-96f75932-0ffb-45aa-851b-744443578250 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:43.068166 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-96f75932-0ffb-45aa-851b-744443578250 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:43.075702 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-96f75932-0ffb-45aa-851b-744443578250 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1681 microversion: 2.1 time: 0.152251 Aug 10 17:06:43.076274 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 663/1308] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:42 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:43.723342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dbdba50d-c362-4303-8d65-e62350ef6536 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:43.723951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dbdba50d-c362-4303-8d65-e62350ef6536 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:43.730966 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbdba50d-c362-4303-8d65-e62350ef6536 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:43.731448 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbdba50d-c362-4303-8d65-e62350ef6536 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:43.731878 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbdba50d-c362-4303-8d65-e62350ef6536 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:43.732585 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbdba50d-c362-4303-8d65-e62350ef6536 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:43.733038 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbdba50d-c362-4303-8d65-e62350ef6536 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:43.733454 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbdba50d-c362-4303-8d65-e62350ef6536 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:43.860231 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-dbdba50d-c362-4303-8d65-e62350ef6536 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:43.867634 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dbdba50d-c362-4303-8d65-e62350ef6536 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.148098 Aug 10 17:06:43.868250 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 646/1309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:43 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:44.098605 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-821a3d33-9bbe-4521-8848-4e49d323c69c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:44.099141 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-821a3d33-9bbe-4521-8848-4e49d323c69c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:44.105455 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-821a3d33-9bbe-4521-8848-4e49d323c69c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:44.105930 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-821a3d33-9bbe-4521-8848-4e49d323c69c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:44.106388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-821a3d33-9bbe-4521-8848-4e49d323c69c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:44.107069 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-821a3d33-9bbe-4521-8848-4e49d323c69c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:44.107512 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-821a3d33-9bbe-4521-8848-4e49d323c69c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:44.107928 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-821a3d33-9bbe-4521-8848-4e49d323c69c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:44.241120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-821a3d33-9bbe-4521-8848-4e49d323c69c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:44.248599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-821a3d33-9bbe-4521-8848-4e49d323c69c tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1681 microversion: 2.1 time: 0.154718 Aug 10 17:06:44.249156 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 664/1310] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:44 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:44.887806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-102f09ef-46b7-4460-9aa6-1b8185ee0f13 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:44.888649 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-102f09ef-46b7-4460-9aa6-1b8185ee0f13 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:44.895269 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-102f09ef-46b7-4460-9aa6-1b8185ee0f13 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:44.895967 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-102f09ef-46b7-4460-9aa6-1b8185ee0f13 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:44.896433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-102f09ef-46b7-4460-9aa6-1b8185ee0f13 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:44.897633 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-102f09ef-46b7-4460-9aa6-1b8185ee0f13 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:44.898083 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-102f09ef-46b7-4460-9aa6-1b8185ee0f13 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:44.898504 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-102f09ef-46b7-4460-9aa6-1b8185ee0f13 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:45.046913 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-102f09ef-46b7-4460-9aa6-1b8185ee0f13 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:45.054180 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:45.066575 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-102f09ef-46b7-4460-9aa6-1b8185ee0f13 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1265 microversion: 2.1 time: 0.182405 Aug 10 17:06:45.074649 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 647/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:44 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:45.270250 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0313948c-5c22-45d8-884c-01a33dbc15a0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:45.271453 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0313948c-5c22-45d8-884c-01a33dbc15a0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:45.278359 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0313948c-5c22-45d8-884c-01a33dbc15a0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:45.278850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0313948c-5c22-45d8-884c-01a33dbc15a0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:45.279282 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0313948c-5c22-45d8-884c-01a33dbc15a0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:45.280089 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0313948c-5c22-45d8-884c-01a33dbc15a0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:45.280572 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0313948c-5c22-45d8-884c-01a33dbc15a0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:45.281193 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0313948c-5c22-45d8-884c-01a33dbc15a0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:45.506624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0313948c-5c22-45d8-884c-01a33dbc15a0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a701149974b45db9f782bc5a232aabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cd009fd06248eebfe0c84b055ef3e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:45.517941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0313948c-5c22-45d8-884c-01a33dbc15a0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 200 len: 1681 microversion: 2.1 time: 0.249035 Aug 10 17:06:45.528813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 665/1312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:45 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:45.923367 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-70b6ccc0-95fb-4390-9702-242f4eb846b0 req-f102374e-409f-4c39-91f2-6dc43c32f602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fed6781-3a30-42e6-9787-79f2f12b53de", "name": "network-vif-deleted", "tag": "d7efa356-be18-4b34-8e2f-1021ac1dcb84"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:06:45.942868 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-70b6ccc0-95fb-4390-9702-242f4eb846b0 req-f102374e-409f-4c39-91f2-6dc43c32f602 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:45.943394 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-70b6ccc0-95fb-4390-9702-242f4eb846b0 req-f102374e-409f-4c39-91f2-6dc43c32f602 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:45.954951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-70b6ccc0-95fb-4390-9702-242f4eb846b0 req-f102374e-409f-4c39-91f2-6dc43c32f602 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:45.972831 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-70b6ccc0-95fb-4390-9702-242f4eb846b0 req-f102374e-409f-4c39-91f2-6dc43c32f602 service nova] Creating event network-vif-deleted:d7efa356-be18-4b34-8e2f-1021ac1dcb84 for instance 0fed6781-3a30-42e6-9787-79f2f12b53de on hv-cinder-83602 Aug 10 17:06:45.980187 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-70b6ccc0-95fb-4390-9702-242f4eb846b0 req-f102374e-409f-4c39-91f2-6dc43c32f602 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061935 Aug 10 17:06:45.985822 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 648/1313] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:46.091383 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-077a22b6-f48b-4ae2-af51-0459562af594 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:46.092122 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-077a22b6-f48b-4ae2-af51-0459562af594 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:46.100945 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-077a22b6-f48b-4ae2-af51-0459562af594 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:46.101870 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-077a22b6-f48b-4ae2-af51-0459562af594 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:46.102583 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-077a22b6-f48b-4ae2-af51-0459562af594 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:46.103472 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-077a22b6-f48b-4ae2-af51-0459562af594 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:46.104085 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-077a22b6-f48b-4ae2-af51-0459562af594 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:46.104696 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-077a22b6-f48b-4ae2-af51-0459562af594 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:46.299105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-077a22b6-f48b-4ae2-af51-0459562af594 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:46.307454 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-077a22b6-f48b-4ae2-af51-0459562af594 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1452 microversion: 2.1 time: 0.223304 Aug 10 17:06:46.321017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 666/1314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:46 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1452 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:46.328770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-639ca5cc-6c2f-4289-8175-f3b41777bc64 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:46.329471 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-639ca5cc-6c2f-4289-8175-f3b41777bc64 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:46.336021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639ca5cc-6c2f-4289-8175-f3b41777bc64 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:46.336743 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639ca5cc-6c2f-4289-8175-f3b41777bc64 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:46.337389 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639ca5cc-6c2f-4289-8175-f3b41777bc64 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:46.338092 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639ca5cc-6c2f-4289-8175-f3b41777bc64 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:46.338713 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639ca5cc-6c2f-4289-8175-f3b41777bc64 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:46.339405 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639ca5cc-6c2f-4289-8175-f3b41777bc64 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:46.514053 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-639ca5cc-6c2f-4289-8175-f3b41777bc64 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:06:46.524059 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-639ca5cc-6c2f-4289-8175-f3b41777bc64 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1452 microversion: 2.1 time: 0.199437 Aug 10 17:06:46.524671 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 649/1315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:46 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1452 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:46.541181 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:46.541897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:46.552390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:46.553449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:46.554112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:46.555599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:46.556302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:46.557040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:46.574377 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de HTTP/1.1 Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:06:46.576461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:46.580386 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '0fed6781-3a30-42e6-9787-79f2f12b53de'} Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:46.581345 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:46.583216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:46.585332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:46.585332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e5959013-5247-445f-8a19-596e3b3074d9 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 404 len: 111 microversion: 2.1 time: 0.042138 Aug 10 17:06:46.585332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 667/1316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:46 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:46.590475 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3aa805ca-1dab-4098-9778-05248c1d4e12 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '.version_select at 0x7f5b08341310>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:46.616942 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3aa805ca-1dab-4098-9778-05248c1d4e12 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101812522" status: 202 len: 0 microversion: 2.1 time: 0.030137 Aug 10 17:06:46.618087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 650/1317] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Aug 10 17:06:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101812522 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:06:48.651164 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:48.651784 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:48.657502 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:48.657994 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:48.658435 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:48.659134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:48.659589 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:48.660013 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:48.673975 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de HTTP/1.1 Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:06:48.675653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:48.677226 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '0fed6781-3a30-42e6-9787-79f2f12b53de'} Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:48.678674 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:48.680189 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:48.682021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:48.682021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-72ee660e-f936-4057-bd7d-103dc301f6b2 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 404 len: 111 microversion: 2.1 time: 0.030839 Aug 10 17:06:48.682021 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 651/1318] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:06:48 2022] DELETE /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:06:48.685932 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:48.686536 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 0fed6781-3a30-42e6-9787-79f2f12b53de] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:48.692650 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:48.693131 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:48.694177 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:48.694866 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:48.695491 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:48.695914 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:48.711798 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de HTTP/1.1 Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:06:48.713623 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:48.715242 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '0fed6781-3a30-42e6-9787-79f2f12b53de'} Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:48.716077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. Aug 10 17:06:48.717666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:48.719102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 0fed6781-3a30-42e6-9787-79f2f12b53de could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:48.719102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c8a7030c-36b6-4e7a-b709-1886496068f0 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de" status: 404 len: 111 microversion: 2.1 time: 0.032497 Aug 10 17:06:48.719102 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 652/1319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:48 2022] GET /compute/v2.1/servers/0fed6781-3a30-42e6-9787-79f2f12b53de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:48.755767 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-4efc273f-d923-4f46-af55-15a9d5d591ac req-6030f179-fde8-44e7-b27a-dfbaeab24133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f6d6951-ebd9-41fb-b41f-86b68db6ae68", "tag": "c2cb00cb-2858-4fe5-9e7a-7be0435be386"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:06:48.766414 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-4efc273f-d923-4f46-af55-15a9d5d591ac req-6030f179-fde8-44e7-b27a-dfbaeab24133 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:48.766929 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-4efc273f-d923-4f46-af55-15a9d5d591ac req-6030f179-fde8-44e7-b27a-dfbaeab24133 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:48.767495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-4efc273f-d923-4f46-af55-15a9d5d591ac req-6030f179-fde8-44e7-b27a-dfbaeab24133 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:48.780302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-4efc273f-d923-4f46-af55-15a9d5d591ac req-6030f179-fde8-44e7-b27a-dfbaeab24133 service nova] Creating event network-changed:c2cb00cb-2858-4fe5-9e7a-7be0435be386 for instance 0f6d6951-ebd9-41fb-b41f-86b68db6ae68 on hv-cinder-83602 Aug 10 17:06:48.786396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-4efc273f-d923-4f46-af55-15a9d5d591ac req-6030f179-fde8-44e7-b27a-dfbaeab24133 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175797 Aug 10 17:06:48.786396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 668/1320] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:49.863305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:49.863787 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:49.870121 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:49.870606 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:49.871042 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:49.871728 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:49.872212 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:49.872639 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:49.886704 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f HTTP/1.1 Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:06:49.888271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:06:49.889861 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '7432bd1c-aa00-4a08-95e9-63b9da22967f'} Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:49.890680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:06:49.891920 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.893258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:49.893258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b45cbd5-82b0-46c5-89a4-f628ebb24e72 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 404 len: 111 microversion: 2.1 time: 0.030185 Aug 10 17:06:49.893258 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 653/1321] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:06:49 2022] DELETE /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:49.899731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:49.900563 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 7432bd1c-aa00-4a08-95e9-63b9da22967f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:49.906762 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:49.907236 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:49.907664 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:49.908366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:49.908813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:49.909229 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:49.911837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=92 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:49.923456 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f HTTP/1.1 Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:06:49.925304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:06:49.926992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '7432bd1c-aa00-4a08-95e9-63b9da22967f'} Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:49.927894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. Aug 10 17:06:49.929361 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.930688 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 7432bd1c-aa00-4a08-95e9-63b9da22967f could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:49.930688 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9f03558c-168a-4e67-8293-ee7d7492c901 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f" status: 404 len: 111 microversion: 2.1 time: 0.032437 Aug 10 17:06:49.930688 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 669/1322] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:49 2022] GET /compute/v2.1/servers/7432bd1c-aa00-4a08-95e9-63b9da22967f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:49.935815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:49.936342 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:49.942369 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:49.942855 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:49.943298 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:49.944531 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:49.944989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:49.945433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:49.958710 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 HTTP/1.1 Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:06:49.961143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:06:49.962763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '43ed24c9-1f9e-48fa-94f0-773f2963e5b9'} Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:49.963689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:06:49.965227 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.966744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:49.966744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5397dc86-8463-4310-9bb7-cdd2c2ac5c7a tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 404 len: 111 microversion: 2.1 time: 0.030712 Aug 10 17:06:49.966744 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 654/1323] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:06:49 2022] DELETE /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:49.970942 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:49.971574 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 43ed24c9-1f9e-48fa-94f0-773f2963e5b9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:49.977447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:49.977917 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:49.978344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:49.979043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:49.979487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:49.980089 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:49.993023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 HTTP/1.1 Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:06:49.994508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:06:49.996054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '43ed24c9-1f9e-48fa-94f0-773f2963e5b9'} Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:49.996995 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. Aug 10 17:06:49.998461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:49.999770 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 43ed24c9-1f9e-48fa-94f0-773f2963e5b9 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:49.999770 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-13676177-44e4-4537-9577-8bceef4231d4 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9" status: 404 len: 111 microversion: 2.1 time: 0.028930 Aug 10 17:06:49.999770 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 670/1324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:49 2022] GET /compute/v2.1/servers/43ed24c9-1f9e-48fa-94f0-773f2963e5b9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:55.339201 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:55.339724 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:55.346137 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:55.346615 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:55.347046 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:55.347755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:55.348232 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:55.348684 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:55.362634 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 HTTP/1.1 Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:06:55.364170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:06:55.365817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '993a10bf-b49d-4027-b117-d167712152e0'} Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:55.366816 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:06:55.368350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:06:55.370233 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:55.370233 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63048b41-100c-4a2f-ad57-faaef4f13534 tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "DELETE /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 404 len: 111 microversion: 2.1 time: 0.030905 Aug 10 17:06:55.370233 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 655/1325] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:06:55 2022] DELETE /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:55.373868 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:55.374501 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] [instance: 993a10bf-b49d-4027-b117-d167712152e0] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:06:55.381059 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:55.381541 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:55.381977 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:55.382704 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:06:55.383149 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:06:55.383568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:06:55.396618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] HTTP exception thrown: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Request method failure captured: Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 HTTP/1.1 Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Lg_mTeIIkandxuC6wRPQSoPlt1vrZEos2XzmoHqQBFbWcambmVmD3esliGRDStfherZqJSAiPBt9ZT5qZgKYtkdlV2lTwuTp3yeGE5VwQ1ykJP8qI3M_1Xhrmuvfj1Q9-6BNGjioOs_9Be8x72OUqzm98Luwp9cfwzEJ1At6izixQ Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:06:55.398690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cd009fd06248eebfe0c84b055ef3e0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cd009fd06248eebfe0c84b055ef3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: a5cd009fd06248eebfe0c84b055ef3e0 Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762959775 Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 7a701149974b45db9f782bc5a232aabe Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-1762959775-project Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:06:55.400369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '993a10bf-b49d-4027-b117-d167712152e0'} Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:06:55.401543 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. Aug 10 17:06:55.403037 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:06:55.404556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] Returning 404 to user: Instance 993a10bf-b49d-4027-b117-d167712152e0 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:06:55.404556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-91929374-3246-4f70-a31b-c6615a2966bd tempest-AttachVolumeNegativeTest-1762959775 tempest-AttachVolumeNegativeTest-1762959775-project] 10.222.0.25 "GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0" status: 404 len: 111 microversion: 2.1 time: 0.030033 Aug 10 17:06:55.404556 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 671/1326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:06:55 2022] GET /compute/v2.1/servers/993a10bf-b49d-4027-b117-d167712152e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:07:01.149461 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-22abbbd5-dd0a-4342-b587-38b0d4de3288 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] Calling method '.version_select at 0x7f5b084de8b0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:01.195545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-22abbbd5-dd0a-4342-b587-38b0d4de3288 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c8e1745b-4044-4a8d-b22f-b531fd7009de" status: 200 len: 351 microversion: 2.1 time: 0.050448 Aug 10 17:07:01.196134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 656/1327] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 17:07:01 2022] GET /compute/v2.1/os-volumes/c8e1745b-4044-4a8d-b22f-b531fd7009de => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:02.520918 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5d948483-2167-4a39-a9a5-5ad22c0fbd80 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] Calling method '.version_select at 0x7f5b083fd1f0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:02.566952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5d948483-2167-4a39-a9a5-5ad22c0fbd80 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0ea8d14c-74fd-4cb5-b6a3-3c3e9a4bbbb2" status: 200 len: 351 microversion: 2.1 time: 0.049731 Aug 10 17:07:02.567536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 672/1328] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 17:07:02 2022] GET /compute/v2.1/os-volumes/0ea8d14c-74fd-4cb5-b6a3-3c3e9a4bbbb2 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:08.098441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:08.099208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=19 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:08.103069 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-24fbc530-d198-4bef-86f2-1f57599d48f6 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] Calling method '.version_select at 0x7f5b0846e3a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:08.150722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-24fbc530-d198-4bef-86f2-1f57599d48f6 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/5b3ee06f-e3f2-4966-8f7a-af1aa238d978" status: 200 len: 350 microversion: 2.1 time: 0.053539 Aug 10 17:07:08.151286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 657/1329] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Aug 10 17:07:08 2022] GET /compute/v2.1/os-volumes/5b3ee06f-e3f2-4966-8f7a-af1aa238d978 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:08.161176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=29 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:08.161852 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=5 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:08.165905 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-aa663084-d232-4d2b-94b7-8b286fd9d5f8 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] Calling method '.version_select at 0x7f5b0cb81160>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:08.248264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-aa663084-d232-4d2b-94b7-8b286fd9d5f8 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088186 Aug 10 17:07:08.248977 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 673/1330] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Aug 10 17:07:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:08.263456 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54d85659-765c-40e1-8f6e-53f22fa41d9b tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] Calling method '.version_select at 0x7f5b08377280>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:08.344498 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-54d85659-765c-40e1-8f6e-53f22fa41d9b tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085266 Aug 10 17:07:08.345062 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 658/1331] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Aug 10 17:07:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:08.358466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-28ca2961-1630-41e1-82c2-bda930869c00 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] Calling method '.version_select at 0x7f5b0cbc69d0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:08.439406 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-28ca2961-1630-41e1-82c2-bda930869c00 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084683 Aug 10 17:07:08.440001 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 674/1332] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Aug 10 17:07:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:08.452944 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53e43c30-dbc8-4ab7-8ae9-7f0184a46cfb tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] Calling method '.version_select at 0x7f5b084b4a60>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:08.539057 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53e43c30-dbc8-4ab7-8ae9-7f0184a46cfb tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089794 Aug 10 17:07:08.539683 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 659/1333] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Aug 10 17:07:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:08.552825 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4e853730-a823-49ce-940e-1c0c28eaadb7 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] Calling method '.version_select at 0x7f5b0caa19d0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:08.634742 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4e853730-a823-49ce-940e-1c0c28eaadb7 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085098 Aug 10 17:07:08.635304 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 675/1334] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Aug 10 17:07:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:08.648490 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a02df052-d1cf-470b-a01d-5ade333b5f3a tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] Calling method '.version_select at 0x7f5b0846edc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:08.731398 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a02df052-d1cf-470b-a01d-5ade333b5f3a tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086517 Aug 10 17:07:08.731996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 660/1335] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Aug 10 17:07:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:08.744963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6be0bc97-039e-471f-a439-80508609f095 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] Calling method '.version_select at 0x7f5b0ca44820>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:08.825065 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6be0bc97-039e-471f-a439-80508609f095 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084163 Aug 10 17:07:08.825637 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 676/1336] 10.222.0.25 () {58 vars in 1188 bytes} [Wed Aug 10 17:07:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:08.838479 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5e503cb-3b1e-49c2-832e-51b9ed4efa36 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] Calling method '.version_select at 0x7f5b0cb0a9d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:08.917604 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5e503cb-3b1e-49c2-832e-51b9ed4efa36 tempest-VolumesTestJSON-2107236590 tempest-VolumesTestJSON-2107236590-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083106 Aug 10 17:07:08.918178 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 661/1337] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Aug 10 17:07:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:15.733014 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-55b5ec95-1de1-4698-8d92-7821ab340394 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:15.733603 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-55b5ec95-1de1-4698-8d92-7821ab340394 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:15.739823 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b5ec95-1de1-4698-8d92-7821ab340394 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:15.740373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b5ec95-1de1-4698-8d92-7821ab340394 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:15.740801 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b5ec95-1de1-4698-8d92-7821ab340394 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:15.742065 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b5ec95-1de1-4698-8d92-7821ab340394 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:15.742793 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b5ec95-1de1-4698-8d92-7821ab340394 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:15.743371 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b5ec95-1de1-4698-8d92-7821ab340394 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:15.778447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-55b5ec95-1de1-4698-8d92-7821ab340394 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:07:15.873364 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-55b5ec95-1de1-4698-8d92-7821ab340394 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 204 len: 0 microversion: 2.1 time: 0.152272 Aug 10 17:07:15.876227 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 677/1338] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:07:15 2022] DELETE /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:07:15.886329 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6ddb1518-37fd-44d9-a4da-20d64e2007df tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:15.887228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6ddb1518-37fd-44d9-a4da-20d64e2007df tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:15.893244 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ddb1518-37fd-44d9-a4da-20d64e2007df tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:15.894186 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ddb1518-37fd-44d9-a4da-20d64e2007df tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:15.895023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ddb1518-37fd-44d9-a4da-20d64e2007df tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:15.896173 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ddb1518-37fd-44d9-a4da-20d64e2007df tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:15.897091 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ddb1518-37fd-44d9-a4da-20d64e2007df tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:15.898111 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ddb1518-37fd-44d9-a4da-20d64e2007df tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:15.945044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4976f89b-9b69-4124-bea6-8a28b1a49f3d req-69610a99-ea9e-44f4-b4eb-a36d309ae4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca57c21-5ab9-42f0-ba5c-158b397c8223", "tag": "25c45962-3be8-4f45-8373-a67dfc93aa99"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:15.967503 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4976f89b-9b69-4124-bea6-8a28b1a49f3d req-69610a99-ea9e-44f4-b4eb-a36d309ae4b9 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:15.967996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4976f89b-9b69-4124-bea6-8a28b1a49f3d req-69610a99-ea9e-44f4-b4eb-a36d309ae4b9 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:15.968474 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4976f89b-9b69-4124-bea6-8a28b1a49f3d req-69610a99-ea9e-44f4-b4eb-a36d309ae4b9 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:15.987063 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4976f89b-9b69-4124-bea6-8a28b1a49f3d req-69610a99-ea9e-44f4-b4eb-a36d309ae4b9 service nova] Creating event network-changed:25c45962-3be8-4f45-8373-a67dfc93aa99 for instance cca57c21-5ab9-42f0-ba5c-158b397c8223 on hv-cinder-83602 Aug 10 17:07:15.994482 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4976f89b-9b69-4124-bea6-8a28b1a49f3d req-69610a99-ea9e-44f4-b4eb-a36d309ae4b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268659 Aug 10 17:07:15.995708 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 662/1339] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:16.068295 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6ddb1518-37fd-44d9-a4da-20d64e2007df tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:16.076542 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6ddb1518-37fd-44d9-a4da-20d64e2007df tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.197150 Aug 10 17:07:16.077209 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 678/1340] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:07:15 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:07:17.099850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-01438af0-19c7-4198-b8c9-469c3485d7f6 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:17.100668 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-01438af0-19c7-4198-b8c9-469c3485d7f6 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:17.107345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01438af0-19c7-4198-b8c9-469c3485d7f6 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:17.107833 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01438af0-19c7-4198-b8c9-469c3485d7f6 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:17.108293 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01438af0-19c7-4198-b8c9-469c3485d7f6 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:17.108990 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01438af0-19c7-4198-b8c9-469c3485d7f6 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:17.109441 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01438af0-19c7-4198-b8c9-469c3485d7f6 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:17.109860 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01438af0-19c7-4198-b8c9-469c3485d7f6 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:17.245774 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-01438af0-19c7-4198-b8c9-469c3485d7f6 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:17.253709 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-01438af0-19c7-4198-b8c9-469c3485d7f6 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.158572 Aug 10 17:07:17.254285 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 663/1341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:07:17 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:18.274759 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-935490fd-65c6-4d9f-9bcd-bea2c2b62998 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:18.276163 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-935490fd-65c6-4d9f-9bcd-bea2c2b62998 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:18.282486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-935490fd-65c6-4d9f-9bcd-bea2c2b62998 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:18.282969 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-935490fd-65c6-4d9f-9bcd-bea2c2b62998 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:18.283403 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-935490fd-65c6-4d9f-9bcd-bea2c2b62998 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:18.284105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-935490fd-65c6-4d9f-9bcd-bea2c2b62998 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:18.284568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-935490fd-65c6-4d9f-9bcd-bea2c2b62998 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:18.285010 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-935490fd-65c6-4d9f-9bcd-bea2c2b62998 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:18.421214 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-935490fd-65c6-4d9f-9bcd-bea2c2b62998 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:18.429267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-935490fd-65c6-4d9f-9bcd-bea2c2b62998 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.158322 Aug 10 17:07:18.430083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 679/1342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:07:18 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:19.450686 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e78cfbdf-e41f-4595-b991-e293774e565a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:19.451291 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e78cfbdf-e41f-4595-b991-e293774e565a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:19.457968 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e78cfbdf-e41f-4595-b991-e293774e565a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:19.458444 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e78cfbdf-e41f-4595-b991-e293774e565a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:19.458874 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e78cfbdf-e41f-4595-b991-e293774e565a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:19.459551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e78cfbdf-e41f-4595-b991-e293774e565a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:19.459998 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e78cfbdf-e41f-4595-b991-e293774e565a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:19.460440 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e78cfbdf-e41f-4595-b991-e293774e565a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:19.591698 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-e78cfbdf-e41f-4595-b991-e293774e565a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:19.599526 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e78cfbdf-e41f-4595-b991-e293774e565a tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.153292 Aug 10 17:07:19.600085 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 664/1343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:07:19 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:20.622865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cbc6c43e-34bd-4c40-8684-7a168f962be0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:20.623483 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cbc6c43e-34bd-4c40-8684-7a168f962be0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:20.629601 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbc6c43e-34bd-4c40-8684-7a168f962be0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:20.630288 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbc6c43e-34bd-4c40-8684-7a168f962be0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:20.630535 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbc6c43e-34bd-4c40-8684-7a168f962be0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:20.631228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbc6c43e-34bd-4c40-8684-7a168f962be0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:20.631685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbc6c43e-34bd-4c40-8684-7a168f962be0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:20.632114 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cbc6c43e-34bd-4c40-8684-7a168f962be0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:21.111466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cbc6c43e-34bd-4c40-8684-7a168f962be0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:21.123339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cbc6c43e-34bd-4c40-8684-7a168f962be0 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1570 microversion: 2.1 time: 0.503137 Aug 10 17:07:21.124026 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 680/1344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:07:20 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1570 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:22.144747 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1815cfe6-e315-402b-9bc4-514a9241318d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:22.145350 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1815cfe6-e315-402b-9bc4-514a9241318d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:22.151273 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1815cfe6-e315-402b-9bc4-514a9241318d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:22.152112 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1815cfe6-e315-402b-9bc4-514a9241318d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:22.152580 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1815cfe6-e315-402b-9bc4-514a9241318d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:22.153286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1815cfe6-e315-402b-9bc4-514a9241318d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:22.154026 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1815cfe6-e315-402b-9bc4-514a9241318d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:22.154135 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1815cfe6-e315-402b-9bc4-514a9241318d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:22.315357 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1815cfe6-e315-402b-9bc4-514a9241318d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:22.324599 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1815cfe6-e315-402b-9bc4-514a9241318d tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1451 microversion: 2.1 time: 0.183661 Aug 10 17:07:22.325743 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 665/1345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:07:22 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1451 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:22.561680 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-9ad46cc0-54ac-4e6d-aee0-71b21ee96f1e req-c1d2c4ce-ea00-4322-a6e7-749222f948ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca57c21-5ab9-42f0-ba5c-158b397c8223", "name": "network-vif-deleted", "tag": "25c45962-3be8-4f45-8373-a67dfc93aa99"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:22.571411 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-9ad46cc0-54ac-4e6d-aee0-71b21ee96f1e req-c1d2c4ce-ea00-4322-a6e7-749222f948ae service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:22.572186 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-9ad46cc0-54ac-4e6d-aee0-71b21ee96f1e req-c1d2c4ce-ea00-4322-a6e7-749222f948ae service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:22.572943 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-9ad46cc0-54ac-4e6d-aee0-71b21ee96f1e req-c1d2c4ce-ea00-4322-a6e7-749222f948ae service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:22.585023 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-9ad46cc0-54ac-4e6d-aee0-71b21ee96f1e req-c1d2c4ce-ea00-4322-a6e7-749222f948ae service nova] Creating event network-vif-deleted:25c45962-3be8-4f45-8373-a67dfc93aa99 for instance cca57c21-5ab9-42f0-ba5c-158b397c8223 on hv-cinder-83602 Aug 10 17:07:22.590841 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-9ad46cc0-54ac-4e6d-aee0-71b21ee96f1e req-c1d2c4ce-ea00-4322-a6e7-749222f948ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032810 Aug 10 17:07:22.591682 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 681/1346] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:23.349545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:23.350154 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:23.357939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:23.358360 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:23.358784 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:23.359530 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:23.360027 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:23.360536 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:23.393644 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:23.394089 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:23.394527 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:23.394969 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lazy-loading 'fault' on Instance uuid cca57c21-5ab9-42f0-ba5c-158b397c8223 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:07:23.441761 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0f55fa4717472db61860fd31f5e427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c868216664144beb0a3a0360c56e637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:23.450438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-22edfd34-e9be-41a4-a1a0-0a3c16ddf580 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 200 len: 1225 microversion: 2.1 time: 0.105234 Aug 10 17:07:23.450997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 666/1347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:07:23 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:24.476502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:24.477290 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] [instance: cca57c21-5ab9-42f0-ba5c-158b397c8223] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:24.483504 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:24.483989 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:24.484463 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:24.485157 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:24.485615 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:24.486042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:24.498848 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] HTTP exception thrown: Instance cca57c21-5ab9-42f0-ba5c-158b397c8223 could not be found. Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Request method failure captured: Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 HTTP/1.1 Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-RXGHx78K64IJAmmlbABeBnktMIxPuuWOQXMpnVS7fZLL44_zmjnMVHun3srqzo8Le0a1UezfGmdkuT1sZnCgap4rGhHJOEhC07j6xLRd8i53UPqeCmC1wjW57dXmi13-_sg6IAyDCWu8WWaULSWxCj9-atl6tO8wYWOYk067luwqY Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 4c868216664144beb0a3a0360c56e637 Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-TestShelveInstance-1854453834 Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:07:24.500460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c868216664144beb0a3a0360c56e637", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c868216664144beb0a3a0360c56e637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c868216664144beb0a3a0360c56e637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c868216664144beb0a3a0360c56e637"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-TestShelveInstance-1854453834 Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 4c868216664144beb0a3a0360c56e637 Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-TestShelveInstance-1854453834 Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-TestShelveInstance-1854453834-project Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 5d0f55fa4717472db61860fd31f5e427 Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-TestShelveInstance-1854453834-project Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance cca57c21-5ab9-42f0-ba5c-158b397c8223 could not be found. Aug 10 17:07:24.502144 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'cca57c21-5ab9-42f0-ba5c-158b397c8223'} Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca57c21-5ab9-42f0-ba5c-158b397c8223 could not be found. Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:24.503264 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca57c21-5ab9-42f0-ba5c-158b397c8223 could not be found. Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca57c21-5ab9-42f0-ba5c-158b397c8223 could not be found. Aug 10 17:07:24.504897 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:24.506401 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Returning 404 to user: Instance cca57c21-5ab9-42f0-ba5c-158b397c8223 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:24.506401 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-af4f4823-9666-401d-8071-a8ff33bd8249 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223" status: 404 len: 111 microversion: 2.1 time: 0.030407 Aug 10 17:07:24.506401 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 682/1348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:07:24 2022] GET /compute/v2.1/servers/cca57c21-5ab9-42f0-ba5c-158b397c8223 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:07:24.665328 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-23c67e10-e118-45ea-9feb-854490df0cc3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] Calling method '.version_select at 0x7f5b085673a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:24.684807 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-23c67e10-e118-45ea-9feb-854490df0cc3 tempest-TestShelveInstance-1854453834 tempest-TestShelveInstance-1854453834-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1933468789" status: 202 len: 0 microversion: 2.1 time: 0.023397 Aug 10 17:07:24.685375 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 667/1349] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Aug 10 17:07:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1933468789 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:07:34.736082 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-04dbeea2-60c3-48c2-bbe0-0e888e5408c7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:34.738487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-04dbeea2-60c3-48c2-bbe0-0e888e5408c7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:34.742731 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:34.743944 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:34.747893 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04dbeea2-60c3-48c2-bbe0-0e888e5408c7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:34.748431 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04dbeea2-60c3-48c2-bbe0-0e888e5408c7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:34.748880 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04dbeea2-60c3-48c2-bbe0-0e888e5408c7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:34.749541 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04dbeea2-60c3-48c2-bbe0-0e888e5408c7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:34.750155 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04dbeea2-60c3-48c2-bbe0-0e888e5408c7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:34.750846 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04dbeea2-60c3-48c2-bbe0-0e888e5408c7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:34.789763 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-04dbeea2-60c3-48c2-bbe0-0e888e5408c7 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057561 Aug 10 17:07:34.791017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 683/1350] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Aug 10 17:07:34 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:34.858928 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=28 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:34.860170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:34.867673 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85ca83ca-71dd-484f-af39-7c1004e26a27 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:34.868202 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85ca83ca-71dd-484f-af39-7c1004e26a27 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:34.876519 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85ca83ca-71dd-484f-af39-7c1004e26a27 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:34.877013 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85ca83ca-71dd-484f-af39-7c1004e26a27 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:34.877457 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85ca83ca-71dd-484f-af39-7c1004e26a27 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:34.878163 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85ca83ca-71dd-484f-af39-7c1004e26a27 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:34.878621 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85ca83ca-71dd-484f-af39-7c1004e26a27 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:34.879049 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85ca83ca-71dd-484f-af39-7c1004e26a27 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:34.915851 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85ca83ca-71dd-484f-af39-7c1004e26a27 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:07:35.010994 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-85ca83ca-71dd-484f-af39-7c1004e26a27 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "DELETE /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 204 len: 0 microversion: 2.20 time: 0.153429 Aug 10 17:07:35.012607 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 668/1351] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Aug 10 17:07:34 2022] DELETE /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 17:07:35.023521 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:35.025360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:35.038719 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:35.039402 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:35.040806 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:35.041623 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:35.042639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:35.043154 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:35.230865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:35.243675 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:35.245467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:35.246823 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c84742d5-6210-4c7a-8b7f-66edc2f31244 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.229407 Aug 10 17:07:35.247719 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 684/1352] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:07:35 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:07:36.270409 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:36.271770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:36.278922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:36.279763 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:36.280533 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:36.294926 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:36.296982 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:36.299549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:36.481574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:36.492482 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:36.495346 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:36.498011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9ba87d42-0de8-4c8b-a726-0413b50c4075 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.231705 Aug 10 17:07:36.498621 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 669/1353] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:07:36 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:07:37.522618 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:37.523293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:37.535778 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:37.536321 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:37.536765 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:37.537480 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:37.537936 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:37.538365 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:38.251452 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:38.259679 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:38.261406 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:38.262657 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4c478fdd-e699-4e22-9158-704da1e83792 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1723 microversion: 2.20 time: 0.744094 Aug 10 17:07:38.263306 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 685/1354] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:07:37 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1723 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:07:38.804187 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a6104ffe-8d61-4b63-af59-1ac115a90438 req-10a7e990-d869-4cc6-b6a1-4dec676e18cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55af62cb-d5be-4fef-b179-39240d0b13cb", "name": "network-vif-deleted", "tag": "228e4301-98ff-4548-915d-d44107e8a96d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:38.818044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a6104ffe-8d61-4b63-af59-1ac115a90438 req-10a7e990-d869-4cc6-b6a1-4dec676e18cb service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:38.818619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a6104ffe-8d61-4b63-af59-1ac115a90438 req-10a7e990-d869-4cc6-b6a1-4dec676e18cb service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:38.819130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a6104ffe-8d61-4b63-af59-1ac115a90438 req-10a7e990-d869-4cc6-b6a1-4dec676e18cb service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:38.834833 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a6104ffe-8d61-4b63-af59-1ac115a90438 req-10a7e990-d869-4cc6-b6a1-4dec676e18cb service nova] Creating event network-vif-deleted:228e4301-98ff-4548-915d-d44107e8a96d for instance 55af62cb-d5be-4fef-b179-39240d0b13cb on hv-cinder-83602 Aug 10 17:07:38.841579 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a6104ffe-8d61-4b63-af59-1ac115a90438 req-10a7e990-d869-4cc6-b6a1-4dec676e18cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041922 Aug 10 17:07:38.842470 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 670/1355] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:39.291249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:39.292676 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:39.300623 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:39.301613 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:39.302298 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:39.303244 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:39.303922 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:39.304764 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:39.358360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:39.359135 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:39.359997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:39.360717 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lazy-loading 'fault' on Instance uuid 55af62cb-d5be-4fef-b179-39240d0b13cb {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:07:39.448937 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:39.465901 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:39.468312 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96495ad2ad764ba3a0fb1e3bc28fd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c2f74324146ca932ff151c9f7a003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:39.469683 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d91243e7-363f-4ee3-a38b-5de2cb6f6509 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 200 len: 1370 microversion: 2.20 time: 0.184000 Aug 10 17:07:39.470444 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 686/1356] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:07:39 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:07:40.494841 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:40.495643 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:40.505746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:40.506244 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:40.506690 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:40.507380 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:40.507827 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:40.508274 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:40.523463 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] HTTP exception thrown: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Request method failure captured: Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb HTTP/1.1 Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-LkD9sTQbcKD13QCfmhebXwBJAiYPGeKWZ-x4UbcerapURqGS8WB8WNddlGrolN6QUV36dmgyGf-Bw3acSdWm48QYs9v1zllrX6Oz6qxzOHwsiQQzaP6buqE6RlJ5V1JbNv5oxxpnj_zTMamZ5goljR_z88bEdeKqaa7KXlnby10-4 Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:07:40.529736 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17c2f74324146ca932ff151c9f7a003", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 96495ad2ad764ba3a0fb1e3bc28fd8bd Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:40.531549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '55af62cb-d5be-4fef-b179-39240d0b13cb'} Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:40.532697 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:40.534252 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:40.535800 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Returning 404 to user: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:40.535800 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ddd44f8-a6ad-4339-b217-4c7c557a8be2 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 404 len: 111 microversion: 2.20 time: 0.041779 Aug 10 17:07:40.535800 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 671/1357] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:07:40 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:07:40.542022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1a05197c-a150-4547-9c85-c931f201527a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '.version_select at 0x7f5b085561f0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:40.566064 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1a05197c-a150-4547-9c85-c931f201527a tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-335601592" status: 204 len: 0 microversion: 2.20 time: 0.028872 Aug 10 17:07:40.566837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 687/1358] 10.222.0.25 () {60 vars in 1259 bytes} [Wed Aug 10 17:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-335601592 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:07:42.439047 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:42.439712 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:42.446822 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:42.447298 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:42.447731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:42.448817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:42.449278 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:42.449698 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:42.467452 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] HTTP exception thrown: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Request method failure captured: Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb HTTP/1.1 Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-LkD9sTQbcKD13QCfmhebXwBJAiYPGeKWZ-x4UbcerapURqGS8WB8WNddlGrolN6QUV36dmgyGf-Bw3acSdWm48QYs9v1zllrX6Oz6qxzOHwsiQQzaP6buqE6RlJ5V1JbNv5oxxpnj_zTMamZ5goljR_z88bEdeKqaa7KXlnby10-4 Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:07:42.469373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17c2f74324146ca932ff151c9f7a003", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 96495ad2ad764ba3a0fb1e3bc28fd8bd Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:42.471079 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '55af62cb-d5be-4fef-b179-39240d0b13cb'} Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:42.471985 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:42.473302 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:42.475472 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Returning 404 to user: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:42.477321 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bba039f9-e54b-4224-84a7-22ffcb37cc74 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "DELETE /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 404 len: 111 microversion: 2.20 time: 0.043829 Aug 10 17:07:42.478453 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 672/1359] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Aug 10 17:07:42 2022] DELETE /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 17:07:42.486714 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:42.487331 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 55af62cb-d5be-4fef-b179-39240d0b13cb] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:42.502241 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:42.502950 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:42.503390 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:42.504112 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:42.505795 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:42.506246 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:42.523727 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] HTTP exception thrown: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Request method failure captured: Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb HTTP/1.1 Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LkD9sTQbcKD13QCfmhebXwBJAiYPGeKWZ-x4UbcerapURqGS8WB8WNddlGrolN6QUV36dmgyGf-Bw3acSdWm48QYs9v1zllrX6Oz6qxzOHwsiQQzaP6buqE6RlJ5V1JbNv5oxxpnj_zTMamZ5goljR_z88bEdeKqaa7KXlnby10-4 Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:07:42.526564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17c2f74324146ca932ff151c9f7a003", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 96495ad2ad764ba3a0fb1e3bc28fd8bd Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:42.528327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '55af62cb-d5be-4fef-b179-39240d0b13cb'} Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:42.529249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. Aug 10 17:07:42.530756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:42.533451 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Returning 404 to user: Instance 55af62cb-d5be-4fef-b179-39240d0b13cb could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:42.534494 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b0decd1d-0e60-40b1-b27a-ad9259e00f68 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb" status: 404 len: 111 microversion: 2.20 time: 0.052241 Aug 10 17:07:42.538397 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 688/1360] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:07:42 2022] GET /compute/v2.1/servers/55af62cb-d5be-4fef-b179-39240d0b13cb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:07:43.755976 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:43.756591 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:43.769869 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:43.770731 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:43.771333 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:43.772459 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:43.773109 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:43.774076 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:43.795239 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] HTTP exception thrown: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Request method failure captured: Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 HTTP/1.1 Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-LkD9sTQbcKD13QCfmhebXwBJAiYPGeKWZ-x4UbcerapURqGS8WB8WNddlGrolN6QUV36dmgyGf-Bw3acSdWm48QYs9v1zllrX6Oz6qxzOHwsiQQzaP6buqE6RlJ5V1JbNv5oxxpnj_zTMamZ5goljR_z88bEdeKqaa7KXlnby10-4 Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:07:43.797620 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17c2f74324146ca932ff151c9f7a003", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: 96495ad2ad764ba3a0fb1e3bc28fd8bd Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:07:43.800303 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '9c45104f-0ee5-4fec-92ad-7937cbe53805'} Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:43.802147 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:07:43.803665 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:07:43.807177 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Returning 404 to user: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:43.808273 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f5d2ff4-22f3-4331-82c0-0fd0ce059750 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 404 len: 111 microversion: 2.20 time: 0.056825 Aug 10 17:07:43.809326 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 673/1361] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Aug 10 17:07:43 2022] DELETE /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:07:43.817899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:43.818774 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] [instance: 9c45104f-0ee5-4fec-92ad-7937cbe53805] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:43.825780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:43.826265 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:43.826700 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:43.827406 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:43.827850 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:43.828302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:43.844988 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] HTTP exception thrown: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Request method failure captured: Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 HTTP/1.1 Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-LkD9sTQbcKD13QCfmhebXwBJAiYPGeKWZ-x4UbcerapURqGS8WB8WNddlGrolN6QUV36dmgyGf-Bw3acSdWm48QYs9v1zllrX6Oz6qxzOHwsiQQzaP6buqE6RlJ5V1JbNv5oxxpnj_zTMamZ5goljR_z88bEdeKqaa7KXlnby10-4 Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:07:43.846692 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17c2f74324146ca932ff151c9f7a003", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17c2f74324146ca932ff151c9f7a003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: d17c2f74324146ca932ff151c9f7a003 Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976613091 Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 96495ad2ad764ba3a0fb1e3bc28fd8bd Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976613091-project Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:07:43.848440 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '9c45104f-0ee5-4fec-92ad-7937cbe53805'} Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:43.849388 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. Aug 10 17:07:43.850946 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:07:43.852893 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] Returning 404 to user: Instance 9c45104f-0ee5-4fec-92ad-7937cbe53805 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:43.852893 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-25633fb1-9f79-4abf-a169-64201b39adf0 tempest-AttachVolumeShelveTestJSON-1976613091 tempest-AttachVolumeShelveTestJSON-1976613091-project] 10.222.0.25 "GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805" status: 404 len: 111 microversion: 2.20 time: 0.034753 Aug 10 17:07:43.855164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 689/1362] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Aug 10 17:07:43 2022] GET /compute/v2.1/servers/9c45104f-0ee5-4fec-92ad-7937cbe53805 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:07:57.353291 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa42a9e0-5ce3-4f9e-a3d9-65423e7ff69f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Action: 'create', calling method: .version_select at 0x7f5b084b4280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-318038365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESDDHj/+zN5q4BNYH9jxlqRG1iKgsj074PF4hKAFOfcwMcbO6ZRYFrv3Vbvpcqu5c4bKS8g9I6NUn0ZyDOh+MnO42H7Ao3pcvsbDHmsu2afod3gM5I2M7mTaXnssR2IgQ=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:57.358899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:57.359546 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:57.373727 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-fa42a9e0-5ce3-4f9e-a3d9-65423e7ff69f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Getting quotas for project d7d69fb708ed447e8a190efb4be9d5f1. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:07:57.378083 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.quota [None req-fa42a9e0-5ce3-4f9e-a3d9-65423e7ff69f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Getting quotas for user 226a40e02432469183e0f8b3360126dc and project d7d69fb708ed447e8a190efb4be9d5f1. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:07:57.399863 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa42a9e0-5ce3-4f9e-a3d9-65423e7ff69f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050400 Aug 10 17:07:57.400494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 674/1363] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Aug 10 17:07:57 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:57.499418 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-853122593", "imageRef": "d3d7b252-ec06-4f46-bced-7b2aff7b1021", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-318038365", "networks": [{"uuid": "fa1fe12c-2248-409e-9b28-83f540c7e639"}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:57.507551 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:57.508744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=30 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:57.552120 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] validate_networks() for [('fa1fe12c-2248-409e-9b28-83f540c7e639', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:07:58.013726 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:07:58.014155 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:07:58.014630 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:07:58.015040 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:07:58.015482 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:07:58.024314 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:58.024799 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:58.025237 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:58.025997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:58.026452 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:58.026894 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:58.043571 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Getting quotas for project d7d69fb708ed447e8a190efb4be9d5f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:07:58.047505 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Getting quotas for user 226a40e02432469183e0f8b3360126dc and project d7d69fb708ed447e8a190efb4be9d5f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:07:58.058837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:07:58.061007 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3d7b252-ec06-4f46-bced-7b2aff7b1021',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:07:58.107524 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0775cd96-7dac-4d36-9efc-bb0f5c26a07b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611954 Aug 10 17:07:58.113985 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 690/1364] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Aug 10 17:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:07:58.119683 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cda0697a-02c3-4d81-936e-004ae7edf216 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:58.120362 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cda0697a-02c3-4d81-936e-004ae7edf216 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:58.178610 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-cda0697a-02c3-4d81-936e-004ae7edf216 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:58.190433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cda0697a-02c3-4d81-936e-004ae7edf216 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1257 microversion: 2.1 time: 0.075227 Aug 10 17:07:58.191262 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 675/1365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:07:58 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1257 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:07:59.211865 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-22dea359-9cda-4eb4-b55d-a74ab7720a7d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:59.212502 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-22dea359-9cda-4eb4-b55d-a74ab7720a7d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:07:59.218486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22dea359-9cda-4eb4-b55d-a74ab7720a7d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:59.218965 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22dea359-9cda-4eb4-b55d-a74ab7720a7d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:59.219396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22dea359-9cda-4eb4-b55d-a74ab7720a7d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:59.220076 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22dea359-9cda-4eb4-b55d-a74ab7720a7d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:07:59.220559 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22dea359-9cda-4eb4-b55d-a74ab7720a7d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:07:59.220980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22dea359-9cda-4eb4-b55d-a74ab7720a7d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:07:59.282860 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-22dea359-9cda-4eb4-b55d-a74ab7720a7d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:07:59.290210 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-22dea359-9cda-4eb4-b55d-a74ab7720a7d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1309 microversion: 2.1 time: 0.083068 Aug 10 17:07:59.290768 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 691/1366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:07:59 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1309 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:00.311280 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ba2bab7-3fe0-49ff-81f7-fc60324f6b19 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:00.312113 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ba2bab7-3fe0-49ff-81f7-fc60324f6b19 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:00.323191 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ba2bab7-3fe0-49ff-81f7-fc60324f6b19 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:00.323683 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ba2bab7-3fe0-49ff-81f7-fc60324f6b19 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:00.324130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ba2bab7-3fe0-49ff-81f7-fc60324f6b19 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:00.324852 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ba2bab7-3fe0-49ff-81f7-fc60324f6b19 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:00.325298 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ba2bab7-3fe0-49ff-81f7-fc60324f6b19 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:00.325722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ba2bab7-3fe0-49ff-81f7-fc60324f6b19 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:00.510991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4ba2bab7-3fe0-49ff-81f7-fc60324f6b19 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:00.519155 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ba2bab7-3fe0-49ff-81f7-fc60324f6b19 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.211913 Aug 10 17:08:00.519747 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 676/1367] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:00 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:01.544920 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ec377084-c100-4e58-a3d2-bca2243d4a3c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:01.545508 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ec377084-c100-4e58-a3d2-bca2243d4a3c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:01.551851 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec377084-c100-4e58-a3d2-bca2243d4a3c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:01.552359 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec377084-c100-4e58-a3d2-bca2243d4a3c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:01.552789 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec377084-c100-4e58-a3d2-bca2243d4a3c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:01.553465 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec377084-c100-4e58-a3d2-bca2243d4a3c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:01.553906 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec377084-c100-4e58-a3d2-bca2243d4a3c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:01.554318 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ec377084-c100-4e58-a3d2-bca2243d4a3c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:01.682434 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ec377084-c100-4e58-a3d2-bca2243d4a3c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:01.689813 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ec377084-c100-4e58-a3d2-bca2243d4a3c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.148711 Aug 10 17:08:01.690374 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 692/1368] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:01 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:02.710032 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14d2afdb-480b-4020-a8c5-0ed13617c0af tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:02.711538 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14d2afdb-480b-4020-a8c5-0ed13617c0af tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:02.718171 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d2afdb-480b-4020-a8c5-0ed13617c0af tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:02.718654 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d2afdb-480b-4020-a8c5-0ed13617c0af tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:02.719087 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d2afdb-480b-4020-a8c5-0ed13617c0af tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:02.719975 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d2afdb-480b-4020-a8c5-0ed13617c0af tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:02.720451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d2afdb-480b-4020-a8c5-0ed13617c0af tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:02.720871 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d2afdb-480b-4020-a8c5-0ed13617c0af tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:02.857398 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-14d2afdb-480b-4020-a8c5-0ed13617c0af tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:02.864774 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14d2afdb-480b-4020-a8c5-0ed13617c0af tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.158590 Aug 10 17:08:02.865372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 677/1369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:02 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:03.886466 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7befff27-1fc6-4048-a274-20a8a67af866 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:03.887057 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7befff27-1fc6-4048-a274-20a8a67af866 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:03.893482 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7befff27-1fc6-4048-a274-20a8a67af866 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:03.894042 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7befff27-1fc6-4048-a274-20a8a67af866 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:03.894396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7befff27-1fc6-4048-a274-20a8a67af866 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:03.896445 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7befff27-1fc6-4048-a274-20a8a67af866 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:03.896916 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7befff27-1fc6-4048-a274-20a8a67af866 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:03.897350 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7befff27-1fc6-4048-a274-20a8a67af866 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:04.022899 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7befff27-1fc6-4048-a274-20a8a67af866 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:04.030177 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7befff27-1fc6-4048-a274-20a8a67af866 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.148103 Aug 10 17:08:04.030734 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 693/1370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:03 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:05.051041 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8af487cc-e3e2-4e19-a427-f6e029bb50cf tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:05.051651 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8af487cc-e3e2-4e19-a427-f6e029bb50cf tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:05.058247 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af487cc-e3e2-4e19-a427-f6e029bb50cf tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:05.058730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af487cc-e3e2-4e19-a427-f6e029bb50cf tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:05.059170 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af487cc-e3e2-4e19-a427-f6e029bb50cf tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:05.059904 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af487cc-e3e2-4e19-a427-f6e029bb50cf tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:05.060380 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af487cc-e3e2-4e19-a427-f6e029bb50cf tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:05.060797 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8af487cc-e3e2-4e19-a427-f6e029bb50cf tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:05.196916 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-8af487cc-e3e2-4e19-a427-f6e029bb50cf tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:05.204445 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8af487cc-e3e2-4e19-a427-f6e029bb50cf tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.157352 Aug 10 17:08:05.205025 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 678/1371] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:05 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:06.226092 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b458a2cb-ce0a-4cb1-bd55-512dcf426c95 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:06.227177 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b458a2cb-ce0a-4cb1-bd55-512dcf426c95 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:06.233515 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b458a2cb-ce0a-4cb1-bd55-512dcf426c95 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:06.233997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b458a2cb-ce0a-4cb1-bd55-512dcf426c95 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:06.234428 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b458a2cb-ce0a-4cb1-bd55-512dcf426c95 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:06.235109 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b458a2cb-ce0a-4cb1-bd55-512dcf426c95 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:06.235558 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b458a2cb-ce0a-4cb1-bd55-512dcf426c95 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:06.235976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b458a2cb-ce0a-4cb1-bd55-512dcf426c95 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:06.365932 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b458a2cb-ce0a-4cb1-bd55-512dcf426c95 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:06.375641 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b458a2cb-ce0a-4cb1-bd55-512dcf426c95 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.153006 Aug 10 17:08:06.376296 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 694/1372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:06 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:07.395669 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d8944126-b558-4190-84ba-5374c8d9136e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:07.396310 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d8944126-b558-4190-84ba-5374c8d9136e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:07.402786 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8944126-b558-4190-84ba-5374c8d9136e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:07.403261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8944126-b558-4190-84ba-5374c8d9136e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:07.403691 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8944126-b558-4190-84ba-5374c8d9136e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:07.404397 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8944126-b558-4190-84ba-5374c8d9136e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:07.404846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8944126-b558-4190-84ba-5374c8d9136e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:07.405265 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8944126-b558-4190-84ba-5374c8d9136e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:07.532769 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d8944126-b558-4190-84ba-5374c8d9136e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:07.540740 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d8944126-b558-4190-84ba-5374c8d9136e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.148941 Aug 10 17:08:07.541298 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 679/1373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:07 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:08.561992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-869aeb42-d711-4c80-b7df-f874cccd60e2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:08.562605 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-869aeb42-d711-4c80-b7df-f874cccd60e2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:08.565164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:08.565855 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:08.572449 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-869aeb42-d711-4c80-b7df-f874cccd60e2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:08.572941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-869aeb42-d711-4c80-b7df-f874cccd60e2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:08.573377 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-869aeb42-d711-4c80-b7df-f874cccd60e2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:08.574079 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-869aeb42-d711-4c80-b7df-f874cccd60e2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:08.574689 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-869aeb42-d711-4c80-b7df-f874cccd60e2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:08.575164 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-869aeb42-d711-4c80-b7df-f874cccd60e2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:08.708836 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-869aeb42-d711-4c80-b7df-f874cccd60e2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:08.717026 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-869aeb42-d711-4c80-b7df-f874cccd60e2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.159427 Aug 10 17:08:08.717584 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 695/1374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:08 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:09.737405 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee28d23e-9d62-4ac2-87af-4ecd2a3bdb8b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:09.738048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee28d23e-9d62-4ac2-87af-4ecd2a3bdb8b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:09.739886 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:09.745946 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee28d23e-9d62-4ac2-87af-4ecd2a3bdb8b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:09.746422 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee28d23e-9d62-4ac2-87af-4ecd2a3bdb8b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:09.746955 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee28d23e-9d62-4ac2-87af-4ecd2a3bdb8b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:09.747602 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee28d23e-9d62-4ac2-87af-4ecd2a3bdb8b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:09.748048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee28d23e-9d62-4ac2-87af-4ecd2a3bdb8b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:09.748493 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee28d23e-9d62-4ac2-87af-4ecd2a3bdb8b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:09.907749 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-ee28d23e-9d62-4ac2-87af-4ecd2a3bdb8b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:09.916476 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ee28d23e-9d62-4ac2-87af-4ecd2a3bdb8b tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.182970 Aug 10 17:08:09.917063 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 680/1375] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:09 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:10.943394 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3d67e3b9-a21d-43f4-92a3-318db61b5794 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:10.945241 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3d67e3b9-a21d-43f4-92a3-318db61b5794 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:10.955703 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d67e3b9-a21d-43f4-92a3-318db61b5794 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:10.956767 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d67e3b9-a21d-43f4-92a3-318db61b5794 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:10.957595 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d67e3b9-a21d-43f4-92a3-318db61b5794 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:10.958823 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d67e3b9-a21d-43f4-92a3-318db61b5794 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:10.959514 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d67e3b9-a21d-43f4-92a3-318db61b5794 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:10.960296 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d67e3b9-a21d-43f4-92a3-318db61b5794 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:11.113366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3d67e3b9-a21d-43f4-92a3-318db61b5794 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:11.121641 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3d67e3b9-a21d-43f4-92a3-318db61b5794 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.185953 Aug 10 17:08:11.125976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 696/1376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:10 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:12.146153 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9351df4e-aaea-4129-81d6-78aaffbb3548 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:12.146762 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9351df4e-aaea-4129-81d6-78aaffbb3548 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:12.153181 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9351df4e-aaea-4129-81d6-78aaffbb3548 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:12.153667 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9351df4e-aaea-4129-81d6-78aaffbb3548 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:12.154110 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9351df4e-aaea-4129-81d6-78aaffbb3548 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:12.154805 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9351df4e-aaea-4129-81d6-78aaffbb3548 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:12.155259 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9351df4e-aaea-4129-81d6-78aaffbb3548 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:12.155688 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9351df4e-aaea-4129-81d6-78aaffbb3548 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:12.310120 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-9351df4e-aaea-4129-81d6-78aaffbb3548 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:12.318078 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9351df4e-aaea-4129-81d6-78aaffbb3548 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.175757 Aug 10 17:08:12.318666 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 681/1377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:12 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:13.340085 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f99d7fcc-46b4-4ac3-a08e-1f9215148edc tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:13.341087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f99d7fcc-46b4-4ac3-a08e-1f9215148edc tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:13.359373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f99d7fcc-46b4-4ac3-a08e-1f9215148edc tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:13.359843 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f99d7fcc-46b4-4ac3-a08e-1f9215148edc tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:13.360308 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f99d7fcc-46b4-4ac3-a08e-1f9215148edc tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:13.361021 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f99d7fcc-46b4-4ac3-a08e-1f9215148edc tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:13.361475 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f99d7fcc-46b4-4ac3-a08e-1f9215148edc tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:13.361893 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f99d7fcc-46b4-4ac3-a08e-1f9215148edc tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:13.539716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f99d7fcc-46b4-4ac3-a08e-1f9215148edc tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:13.547119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f99d7fcc-46b4-4ac3-a08e-1f9215148edc tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.212168 Aug 10 17:08:13.547913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 697/1378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:13 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:14.568116 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be6afbb9-c38b-409c-982e-bd81c8eebbce tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:14.568742 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-be6afbb9-c38b-409c-982e-bd81c8eebbce tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:14.575433 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be6afbb9-c38b-409c-982e-bd81c8eebbce tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:14.575926 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be6afbb9-c38b-409c-982e-bd81c8eebbce tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:14.576396 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be6afbb9-c38b-409c-982e-bd81c8eebbce tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:14.577125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be6afbb9-c38b-409c-982e-bd81c8eebbce tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:14.577580 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be6afbb9-c38b-409c-982e-bd81c8eebbce tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:14.578007 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be6afbb9-c38b-409c-982e-bd81c8eebbce tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:14.723931 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-be6afbb9-c38b-409c-982e-bd81c8eebbce tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:14.733130 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-be6afbb9-c38b-409c-982e-bd81c8eebbce tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.168776 Aug 10 17:08:14.733790 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 682/1379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:14 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:15.756054 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2a204b13-ff08-4f42-a418-f8a231f1861d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:15.756713 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2a204b13-ff08-4f42-a418-f8a231f1861d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:15.764000 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a204b13-ff08-4f42-a418-f8a231f1861d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:15.764526 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a204b13-ff08-4f42-a418-f8a231f1861d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:15.764958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a204b13-ff08-4f42-a418-f8a231f1861d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:15.765657 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a204b13-ff08-4f42-a418-f8a231f1861d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:15.766106 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a204b13-ff08-4f42-a418-f8a231f1861d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:15.766530 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a204b13-ff08-4f42-a418-f8a231f1861d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:15.897027 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2a204b13-ff08-4f42-a418-f8a231f1861d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:15.905608 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2a204b13-ff08-4f42-a418-f8a231f1861d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.154181 Aug 10 17:08:15.906248 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 698/1380] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:15 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:16.930381 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5e416e42-0cb0-4d2c-8bf1-ac92c51d1d66 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:16.932295 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5e416e42-0cb0-4d2c-8bf1-ac92c51d1d66 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:16.939523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e416e42-0cb0-4d2c-8bf1-ac92c51d1d66 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:16.940089 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e416e42-0cb0-4d2c-8bf1-ac92c51d1d66 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:16.940615 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e416e42-0cb0-4d2c-8bf1-ac92c51d1d66 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:16.941566 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e416e42-0cb0-4d2c-8bf1-ac92c51d1d66 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:16.942431 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e416e42-0cb0-4d2c-8bf1-ac92c51d1d66 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:16.942995 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e416e42-0cb0-4d2c-8bf1-ac92c51d1d66 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:17.110133 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-5e416e42-0cb0-4d2c-8bf1-ac92c51d1d66 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:17.122221 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5e416e42-0cb0-4d2c-8bf1-ac92c51d1d66 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.197124 Aug 10 17:08:17.122804 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 683/1381] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:16 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:17.211527 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-38672eeb-016f-428f-941d-39de1ba1c70e req-98ba1d95-8b08-4154-b96a-0b67413ad96d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa276f8-e157-44af-a52d-6e7a4565683e", "tag": "d6c042fa-473d-49e5-83ca-b4b9312cfedd"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:08:17.224933 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-38672eeb-016f-428f-941d-39de1ba1c70e req-98ba1d95-8b08-4154-b96a-0b67413ad96d service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:17.227013 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-38672eeb-016f-428f-941d-39de1ba1c70e req-98ba1d95-8b08-4154-b96a-0b67413ad96d service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:17.227460 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-38672eeb-016f-428f-941d-39de1ba1c70e req-98ba1d95-8b08-4154-b96a-0b67413ad96d service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:17.240932 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-38672eeb-016f-428f-941d-39de1ba1c70e req-98ba1d95-8b08-4154-b96a-0b67413ad96d service nova] Creating event network-changed:d6c042fa-473d-49e5-83ca-b4b9312cfedd for instance 7fa276f8-e157-44af-a52d-6e7a4565683e on hv-cinder-83602 Aug 10 17:08:17.246070 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-38672eeb-016f-428f-941d-39de1ba1c70e req-98ba1d95-8b08-4154-b96a-0b67413ad96d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041434 Aug 10 17:08:17.247028 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 699/1382] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:08:18.142689 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-26dfa4c8-fbba-459f-b80b-ca029c1e1ca6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:18.143293 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-26dfa4c8-fbba-459f-b80b-ca029c1e1ca6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:18.149789 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26dfa4c8-fbba-459f-b80b-ca029c1e1ca6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:18.150826 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26dfa4c8-fbba-459f-b80b-ca029c1e1ca6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:18.151254 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26dfa4c8-fbba-459f-b80b-ca029c1e1ca6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:18.151951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26dfa4c8-fbba-459f-b80b-ca029c1e1ca6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:18.152440 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26dfa4c8-fbba-459f-b80b-ca029c1e1ca6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:18.152851 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26dfa4c8-fbba-459f-b80b-ca029c1e1ca6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:18.289364 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-26dfa4c8-fbba-459f-b80b-ca029c1e1ca6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:18.296944 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-26dfa4c8-fbba-459f-b80b-ca029c1e1ca6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.157990 Aug 10 17:08:18.297805 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 684/1383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:18 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:19.319147 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-72c4f427-cd01-4c84-8750-2891e42abb9e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:19.319837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-72c4f427-cd01-4c84-8750-2891e42abb9e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:19.325770 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72c4f427-cd01-4c84-8750-2891e42abb9e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:19.326213 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72c4f427-cd01-4c84-8750-2891e42abb9e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:19.326639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72c4f427-cd01-4c84-8750-2891e42abb9e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:19.327319 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72c4f427-cd01-4c84-8750-2891e42abb9e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:19.327766 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72c4f427-cd01-4c84-8750-2891e42abb9e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:19.328205 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-72c4f427-cd01-4c84-8750-2891e42abb9e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:19.473055 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-72c4f427-cd01-4c84-8750-2891e42abb9e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:19.482043 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-72c4f427-cd01-4c84-8750-2891e42abb9e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.167483 Aug 10 17:08:19.482635 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 700/1384] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:19 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:20.503456 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-582711d5-86cc-422d-9f25-fb3f56cc35d0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:20.504050 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-582711d5-86cc-422d-9f25-fb3f56cc35d0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:20.510616 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582711d5-86cc-422d-9f25-fb3f56cc35d0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:20.511109 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582711d5-86cc-422d-9f25-fb3f56cc35d0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:20.511547 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582711d5-86cc-422d-9f25-fb3f56cc35d0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:20.512274 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582711d5-86cc-422d-9f25-fb3f56cc35d0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:20.512733 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582711d5-86cc-422d-9f25-fb3f56cc35d0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:20.513161 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582711d5-86cc-422d-9f25-fb3f56cc35d0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:20.642426 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-582711d5-86cc-422d-9f25-fb3f56cc35d0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:20.649723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-582711d5-86cc-422d-9f25-fb3f56cc35d0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.150190 Aug 10 17:08:20.650285 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 685/1385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:20 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:21.670862 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-089ae7dd-8e0e-45be-af74-92fd426c8f0c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:21.671389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-089ae7dd-8e0e-45be-af74-92fd426c8f0c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:21.677555 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-089ae7dd-8e0e-45be-af74-92fd426c8f0c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:21.678036 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-089ae7dd-8e0e-45be-af74-92fd426c8f0c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:21.678474 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-089ae7dd-8e0e-45be-af74-92fd426c8f0c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:21.679156 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-089ae7dd-8e0e-45be-af74-92fd426c8f0c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:21.679604 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-089ae7dd-8e0e-45be-af74-92fd426c8f0c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:21.680029 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-089ae7dd-8e0e-45be-af74-92fd426c8f0c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:21.808057 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-089ae7dd-8e0e-45be-af74-92fd426c8f0c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:21.815615 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-089ae7dd-8e0e-45be-af74-92fd426c8f0c tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.148681 Aug 10 17:08:21.816199 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 701/1386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:21 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:22.837121 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4312b3ad-a474-4981-9753-a43f8fec06b9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:22.838619 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4312b3ad-a474-4981-9753-a43f8fec06b9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:22.844971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4312b3ad-a474-4981-9753-a43f8fec06b9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:22.845535 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4312b3ad-a474-4981-9753-a43f8fec06b9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:22.846040 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4312b3ad-a474-4981-9753-a43f8fec06b9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:22.846843 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4312b3ad-a474-4981-9753-a43f8fec06b9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:22.847386 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4312b3ad-a474-4981-9753-a43f8fec06b9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:22.847874 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4312b3ad-a474-4981-9753-a43f8fec06b9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:22.995927 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-4312b3ad-a474-4981-9753-a43f8fec06b9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:23.003846 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4312b3ad-a474-4981-9753-a43f8fec06b9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.171378 Aug 10 17:08:23.004541 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 686/1387] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:22 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:24.025871 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9bc08079-50d1-4f57-8cda-24548facf834 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:24.026487 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9bc08079-50d1-4f57-8cda-24548facf834 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:24.033039 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9bc08079-50d1-4f57-8cda-24548facf834 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:24.033523 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9bc08079-50d1-4f57-8cda-24548facf834 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:24.033958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9bc08079-50d1-4f57-8cda-24548facf834 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:24.034656 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9bc08079-50d1-4f57-8cda-24548facf834 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:24.035113 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9bc08079-50d1-4f57-8cda-24548facf834 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:24.035544 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9bc08079-50d1-4f57-8cda-24548facf834 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:24.169489 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9bc08079-50d1-4f57-8cda-24548facf834 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:24.177062 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9bc08079-50d1-4f57-8cda-24548facf834 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.155710 Aug 10 17:08:24.177649 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 702/1388] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:24 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:24.387111 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-2ce2d768-5a15-439f-bc7c-94302f92fd50 req-07455cf0-65ec-4acb-b930-df9cb9d338a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa276f8-e157-44af-a52d-6e7a4565683e", "name": "network-vif-plugged", "status": "completed", "tag": "d6c042fa-473d-49e5-83ca-b4b9312cfedd"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:08:24.401680 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2ce2d768-5a15-439f-bc7c-94302f92fd50 req-07455cf0-65ec-4acb-b930-df9cb9d338a7 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:24.402251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2ce2d768-5a15-439f-bc7c-94302f92fd50 req-07455cf0-65ec-4acb-b930-df9cb9d338a7 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:24.402754 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2ce2d768-5a15-439f-bc7c-94302f92fd50 req-07455cf0-65ec-4acb-b930-df9cb9d338a7 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:24.423341 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-2ce2d768-5a15-439f-bc7c-94302f92fd50 req-07455cf0-65ec-4acb-b930-df9cb9d338a7 service nova] Creating event network-vif-plugged:d6c042fa-473d-49e5-83ca-b4b9312cfedd for instance 7fa276f8-e157-44af-a52d-6e7a4565683e on hv-cinder-83602 Aug 10 17:08:24.431911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-2ce2d768-5a15-439f-bc7c-94302f92fd50 req-07455cf0-65ec-4acb-b930-df9cb9d338a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049830 Aug 10 17:08:24.433601 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 687/1389] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:08:25.198263 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c048cc1a-9434-427f-aa67-3777061f43e8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:25.198874 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c048cc1a-9434-427f-aa67-3777061f43e8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:25.205395 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c048cc1a-9434-427f-aa67-3777061f43e8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:25.205884 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c048cc1a-9434-427f-aa67-3777061f43e8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:25.206350 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c048cc1a-9434-427f-aa67-3777061f43e8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:25.207044 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c048cc1a-9434-427f-aa67-3777061f43e8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:25.207495 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c048cc1a-9434-427f-aa67-3777061f43e8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:25.207921 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c048cc1a-9434-427f-aa67-3777061f43e8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:25.342111 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c048cc1a-9434-427f-aa67-3777061f43e8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:25.349982 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c048cc1a-9434-427f-aa67-3777061f43e8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.155967 Aug 10 17:08:25.350836 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 703/1390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:25 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:26.372082 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05fad76c-6616-4488-a8fa-5294de19ac38 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:26.372848 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05fad76c-6616-4488-a8fa-5294de19ac38 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:26.379522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05fad76c-6616-4488-a8fa-5294de19ac38 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:26.380075 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05fad76c-6616-4488-a8fa-5294de19ac38 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:26.380549 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05fad76c-6616-4488-a8fa-5294de19ac38 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:26.381405 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05fad76c-6616-4488-a8fa-5294de19ac38 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:26.381991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05fad76c-6616-4488-a8fa-5294de19ac38 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:26.382997 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05fad76c-6616-4488-a8fa-5294de19ac38 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:26.518941 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-05fad76c-6616-4488-a8fa-5294de19ac38 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:26.527098 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05fad76c-6616-4488-a8fa-5294de19ac38 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1357 microversion: 2.1 time: 0.159708 Aug 10 17:08:26.527681 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 688/1391] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:26 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:27.547756 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ca1bd7b8-0380-4616-ae3e-2c29de3d859d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:27.548327 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ca1bd7b8-0380-4616-ae3e-2c29de3d859d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:27.550707 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:27.557099 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1bd7b8-0380-4616-ae3e-2c29de3d859d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:27.557589 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1bd7b8-0380-4616-ae3e-2c29de3d859d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:27.558020 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1bd7b8-0380-4616-ae3e-2c29de3d859d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:27.558719 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1bd7b8-0380-4616-ae3e-2c29de3d859d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:27.559200 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1bd7b8-0380-4616-ae3e-2c29de3d859d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:27.559620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca1bd7b8-0380-4616-ae3e-2c29de3d859d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:27.564498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=77 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:27.695769 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ca1bd7b8-0380-4616-ae3e-2c29de3d859d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:27.704097 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ca1bd7b8-0380-4616-ae3e-2c29de3d859d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1547 microversion: 2.1 time: 0.160310 Aug 10 17:08:27.704701 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 704/1392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:27 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:27.724422 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-60f40a8b-fc9f-4e1c-ad6d-bb71c5210ee2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:27.725030 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-60f40a8b-fc9f-4e1c-ad6d-bb71c5210ee2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:27.727987 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:27.733261 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60f40a8b-fc9f-4e1c-ad6d-bb71c5210ee2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:27.733746 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60f40a8b-fc9f-4e1c-ad6d-bb71c5210ee2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:27.734176 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60f40a8b-fc9f-4e1c-ad6d-bb71c5210ee2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:27.734965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60f40a8b-fc9f-4e1c-ad6d-bb71c5210ee2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:27.735413 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60f40a8b-fc9f-4e1c-ad6d-bb71c5210ee2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:27.736019 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60f40a8b-fc9f-4e1c-ad6d-bb71c5210ee2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:27.740801 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=75 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:27.870457 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-60f40a8b-fc9f-4e1c-ad6d-bb71c5210ee2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:27.878026 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-60f40a8b-fc9f-4e1c-ad6d-bb71c5210ee2 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1547 microversion: 2.1 time: 0.157353 Aug 10 17:08:27.878590 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 689/1393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:27 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:27.898153 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8fd3bcf0-8a70-4182-bd8c-1cb33a7590f5 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:27.902901 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8fd3bcf0-8a70-4182-bd8c-1cb33a7590f5 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:27.903657 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8fd3bcf0-8a70-4182-bd8c-1cb33a7590f5 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Searching by: {'deleted': False, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1'} {{(pid=120608) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:08:27.910086 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fd3bcf0-8a70-4182-bd8c-1cb33a7590f5 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:27.910563 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fd3bcf0-8a70-4182-bd8c-1cb33a7590f5 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:27.910997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fd3bcf0-8a70-4182-bd8c-1cb33a7590f5 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:27.911716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fd3bcf0-8a70-4182-bd8c-1cb33a7590f5 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:27.912187 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fd3bcf0-8a70-4182-bd8c-1cb33a7590f5 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:27.912616 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fd3bcf0-8a70-4182-bd8c-1cb33a7590f5 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:28.005141 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.multi_cell_list [None req-8fd3bcf0-8a70-4182-bd8c-1cb33a7590f5 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120608) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 17:08:28.102981 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8fd3bcf0-8a70-4182-bd8c-1cb33a7590f5 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208596 Aug 10 17:08:28.103568 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 705/1394] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Aug 10 17:08:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:08:28.115455 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b15154e2-d267-4bf4-8e62-f663f84444e3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:28.116064 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b15154e2-d267-4bf4-8e62-f663f84444e3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:28.122648 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15154e2-d267-4bf4-8e62-f663f84444e3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:28.123135 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15154e2-d267-4bf4-8e62-f663f84444e3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:28.123573 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15154e2-d267-4bf4-8e62-f663f84444e3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:28.128358 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15154e2-d267-4bf4-8e62-f663f84444e3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:28.128358 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15154e2-d267-4bf4-8e62-f663f84444e3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:28.128358 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15154e2-d267-4bf4-8e62-f663f84444e3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:28.252739 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b15154e2-d267-4bf4-8e62-f663f84444e3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:28.260755 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b15154e2-d267-4bf4-8e62-f663f84444e3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1547 microversion: 2.1 time: 0.149098 Aug 10 17:08:28.261330 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 690/1395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:28 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:29.831977 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-094f486d-9cd4-47d4-afe3-13c02531184e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5e99193-3e7e-4894-b6a2-3d790d5bca17"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:08:29.834370 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-094f486d-9cd4-47d4-afe3-13c02531184e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:29.841178 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094f486d-9cd4-47d4-afe3-13c02531184e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:29.841666 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094f486d-9cd4-47d4-afe3-13c02531184e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:29.842101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094f486d-9cd4-47d4-afe3-13c02531184e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:29.842796 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094f486d-9cd4-47d4-afe3-13c02531184e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:29.843248 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094f486d-9cd4-47d4-afe3-13c02531184e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:29.843672 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094f486d-9cd4-47d4-afe3-13c02531184e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:30.117329 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-094f486d-9cd4-47d4-afe3-13c02531184e tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "POST /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288569 Aug 10 17:08:30.118079 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 706/1396] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Aug 10 17:08:29 2022] POST /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:08:37.738757 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d7e5e86-1c5b-49c4-94d7-fcb44fd37d10 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:37.739372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d7e5e86-1c5b-49c4-94d7-fcb44fd37d10 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:37.746628 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d7e5e86-1c5b-49c4-94d7-fcb44fd37d10 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:37.747118 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d7e5e86-1c5b-49c4-94d7-fcb44fd37d10 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:37.747554 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d7e5e86-1c5b-49c4-94d7-fcb44fd37d10 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:37.748298 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d7e5e86-1c5b-49c4-94d7-fcb44fd37d10 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:37.748758 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d7e5e86-1c5b-49c4-94d7-fcb44fd37d10 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:37.749181 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d7e5e86-1c5b-49c4-94d7-fcb44fd37d10 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:37.877708 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d7e5e86-1c5b-49c4-94d7-fcb44fd37d10 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:37.886372 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d7e5e86-1c5b-49c4-94d7-fcb44fd37d10 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1593 microversion: 2.1 time: 0.151354 Aug 10 17:08:37.887116 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 691/1397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:37 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1593 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:39.876498 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:39.881068 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=5 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:39.885997 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-6e25f9ef-d1ee-4d01-9fed-11044acfe6d1 req-b6a8085b-af18-475e-a88e-e433e0e3987d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa276f8-e157-44af-a52d-6e7a4565683e", "tag": "d6c042fa-473d-49e5-83ca-b4b9312cfedd"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:08:39.904071 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-6e25f9ef-d1ee-4d01-9fed-11044acfe6d1 req-b6a8085b-af18-475e-a88e-e433e0e3987d service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:39.904752 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-6e25f9ef-d1ee-4d01-9fed-11044acfe6d1 req-b6a8085b-af18-475e-a88e-e433e0e3987d service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:39.905289 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-6e25f9ef-d1ee-4d01-9fed-11044acfe6d1 req-b6a8085b-af18-475e-a88e-e433e0e3987d service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:39.917633 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-6e25f9ef-d1ee-4d01-9fed-11044acfe6d1 req-b6a8085b-af18-475e-a88e-e433e0e3987d service nova] Creating event network-changed:d6c042fa-473d-49e5-83ca-b4b9312cfedd for instance 7fa276f8-e157-44af-a52d-6e7a4565683e on hv-cinder-83602 Aug 10 17:08:39.922793 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-6e25f9ef-d1ee-4d01-9fed-11044acfe6d1 req-b6a8085b-af18-475e-a88e-e433e0e3987d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047691 Aug 10 17:08:39.923690 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 707/1398] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:08:40.961730 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-11a79a2b-65fb-4b33-b4c7-dfbc03700ff9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1986694144"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:08:40.962916 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-11a79a2b-65fb-4b33-b4c7-dfbc03700ff9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:40.969217 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11a79a2b-65fb-4b33-b4c7-dfbc03700ff9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:40.969770 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11a79a2b-65fb-4b33-b4c7-dfbc03700ff9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:40.970271 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11a79a2b-65fb-4b33-b4c7-dfbc03700ff9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:40.970969 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11a79a2b-65fb-4b33-b4c7-dfbc03700ff9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:40.971418 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11a79a2b-65fb-4b33-b4c7-dfbc03700ff9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:40.971839 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11a79a2b-65fb-4b33-b4c7-dfbc03700ff9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:41.104013 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.network.security_group_api [None req-11a79a2b-65fb-4b33-b4c7-dfbc03700ff9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Adding security group 1fc03878-78d7-46b0-aba3-e0acff44f84f to port d6c042fa-473d-49e5-83ca-b4b9312cfedd Aug 10 17:08:41.414161 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-11a79a2b-65fb-4b33-b4c7-dfbc03700ff9 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "POST /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/action" status: 202 len: 0 microversion: 2.1 time: 0.456638 Aug 10 17:08:41.414795 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 692/1399] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 17:08:40 2022] POST /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:08:41.423293 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4c097687-48a6-44b4-bed2-82db4b2e9c0f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:41.423998 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4c097687-48a6-44b4-bed2-82db4b2e9c0f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:08:41.431241 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c097687-48a6-44b4-bed2-82db4b2e9c0f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:41.431780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c097687-48a6-44b4-bed2-82db4b2e9c0f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:41.432467 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c097687-48a6-44b4-bed2-82db4b2e9c0f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:41.433172 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c097687-48a6-44b4-bed2-82db4b2e9c0f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:41.433694 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c097687-48a6-44b4-bed2-82db4b2e9c0f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:41.434479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c097687-48a6-44b4-bed2-82db4b2e9c0f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:41.579594 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4c097687-48a6-44b4-bed2-82db4b2e9c0f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:08:41.587960 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4c097687-48a6-44b4-bed2-82db4b2e9c0f tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1758 microversion: 2.1 time: 0.168775 Aug 10 17:08:41.588565 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 708/1400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:08:41 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:41.944024 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-8c183cf0-a414-4792-b6d0-7c4d15212335 req-1af98173-8b9d-4ee2-8483-2c19ac48492e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa276f8-e157-44af-a52d-6e7a4565683e", "tag": "d6c042fa-473d-49e5-83ca-b4b9312cfedd"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:08:41.956940 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c183cf0-a414-4792-b6d0-7c4d15212335 req-1af98173-8b9d-4ee2-8483-2c19ac48492e service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:08:41.957463 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c183cf0-a414-4792-b6d0-7c4d15212335 req-1af98173-8b9d-4ee2-8483-2c19ac48492e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:08:41.958022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c183cf0-a414-4792-b6d0-7c4d15212335 req-1af98173-8b9d-4ee2-8483-2c19ac48492e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:08:41.972373 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-8c183cf0-a414-4792-b6d0-7c4d15212335 req-1af98173-8b9d-4ee2-8483-2c19ac48492e service nova] Creating event network-changed:d6c042fa-473d-49e5-83ca-b4b9312cfedd for instance 7fa276f8-e157-44af-a52d-6e7a4565683e on hv-cinder-83602 Aug 10 17:08:41.981337 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-8c183cf0-a414-4792-b6d0-7c4d15212335 req-1af98173-8b9d-4ee2-8483-2c19ac48492e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043228 Aug 10 17:08:41.981956 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 693/1401] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:09:20.177651 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b7f9861c-abbd-44fb-9c35-76e971eae20b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:20.178191 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b7f9861c-abbd-44fb-9c35-76e971eae20b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:20.180295 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=4 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:20.180936 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:20.186739 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-fe27ac3a-642f-4a51-83a4-f7c56b1b0ee2 req-5e70bd3c-8951-4a58-b054-57042f69279e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f6d6951-ebd9-41fb-b41f-86b68db6ae68", "tag": "c2cb00cb-2858-4fe5-9e7a-7be0435be386"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:09:20.191696 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=9 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:20.192464 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=23 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:20.198911 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fe27ac3a-642f-4a51-83a4-f7c56b1b0ee2 req-5e70bd3c-8951-4a58-b054-57042f69279e service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:20.199106 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7f9861c-abbd-44fb-9c35-76e971eae20b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:20.199874 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fe27ac3a-642f-4a51-83a4-f7c56b1b0ee2 req-5e70bd3c-8951-4a58-b054-57042f69279e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:20.200026 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7f9861c-abbd-44fb-9c35-76e971eae20b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:20.200134 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fe27ac3a-642f-4a51-83a4-f7c56b1b0ee2 req-5e70bd3c-8951-4a58-b054-57042f69279e service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:20.200332 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7f9861c-abbd-44fb-9c35-76e971eae20b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:20.201096 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7f9861c-abbd-44fb-9c35-76e971eae20b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:20.201557 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7f9861c-abbd-44fb-9c35-76e971eae20b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:20.201979 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7f9861c-abbd-44fb-9c35-76e971eae20b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:20.212806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-fe27ac3a-642f-4a51-83a4-f7c56b1b0ee2 req-5e70bd3c-8951-4a58-b054-57042f69279e service nova] Creating event network-changed:c2cb00cb-2858-4fe5-9e7a-7be0435be386 for instance 0f6d6951-ebd9-41fb-b41f-86b68db6ae68 on hv-cinder-83602 Aug 10 17:09:20.218658 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-fe27ac3a-642f-4a51-83a4-f7c56b1b0ee2 req-5e70bd3c-8951-4a58-b054-57042f69279e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036007 Aug 10 17:09:20.219480 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 694/1402] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:09:20.229801 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b7f9861c-abbd-44fb-9c35-76e971eae20b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:09:20.318032 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b7f9861c-abbd-44fb-9c35-76e971eae20b tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 204 len: 0 microversion: 2.1 time: 0.144157 Aug 10 17:09:20.320022 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 709/1403] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:09:20 2022] DELETE /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:09:20.328719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1c61a57e-95d5-466b-9e36-73afcf15d277 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:20.329672 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1c61a57e-95d5-466b-9e36-73afcf15d277 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:20.338169 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c61a57e-95d5-466b-9e36-73afcf15d277 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:20.338745 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c61a57e-95d5-466b-9e36-73afcf15d277 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:20.339255 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c61a57e-95d5-466b-9e36-73afcf15d277 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:20.340030 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c61a57e-95d5-466b-9e36-73afcf15d277 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:20.340578 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c61a57e-95d5-466b-9e36-73afcf15d277 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:20.341077 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c61a57e-95d5-466b-9e36-73afcf15d277 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:20.476896 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-1c61a57e-95d5-466b-9e36-73afcf15d277 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:09:20.484429 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1c61a57e-95d5-466b-9e36-73afcf15d277 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1577 microversion: 2.1 time: 0.160243 Aug 10 17:09:20.484986 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 695/1404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:09:20 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:09:21.507389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8b44fee2-7f4c-4418-a206-6fc6fa346146 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:21.507797 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8b44fee2-7f4c-4418-a206-6fc6fa346146 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:21.514117 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b44fee2-7f4c-4418-a206-6fc6fa346146 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:21.514599 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b44fee2-7f4c-4418-a206-6fc6fa346146 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:21.515033 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b44fee2-7f4c-4418-a206-6fc6fa346146 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:21.515716 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b44fee2-7f4c-4418-a206-6fc6fa346146 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:21.516194 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b44fee2-7f4c-4418-a206-6fc6fa346146 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:21.516610 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8b44fee2-7f4c-4418-a206-6fc6fa346146 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:21.744105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8b44fee2-7f4c-4418-a206-6fc6fa346146 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:09:21.751968 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8b44fee2-7f4c-4418-a206-6fc6fa346146 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1577 microversion: 2.1 time: 0.249469 Aug 10 17:09:21.752596 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 710/1405] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:09:21 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1577 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:09:22.774223 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ebcfcda-d7ff-4df5-9eea-f44f5b4850ec tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:22.774850 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0ebcfcda-d7ff-4df5-9eea-f44f5b4850ec tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:22.782973 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ebcfcda-d7ff-4df5-9eea-f44f5b4850ec tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:22.783632 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ebcfcda-d7ff-4df5-9eea-f44f5b4850ec tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:22.784078 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ebcfcda-d7ff-4df5-9eea-f44f5b4850ec tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:22.784873 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ebcfcda-d7ff-4df5-9eea-f44f5b4850ec tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:22.785631 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ebcfcda-d7ff-4df5-9eea-f44f5b4850ec tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:22.786082 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ebcfcda-d7ff-4df5-9eea-f44f5b4850ec tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:22.922951 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ebcfcda-d7ff-4df5-9eea-f44f5b4850ec tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:09:22.931773 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0ebcfcda-d7ff-4df5-9eea-f44f5b4850ec tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 200 len: 1458 microversion: 2.1 time: 0.161770 Aug 10 17:09:22.932815 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 696/1406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:09:22 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:09:23.029273 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-5f90282c-1516-4385-850a-0f108ac0685d req-7bb2f4f5-a0df-47ce-8ad9-0aa62af5a858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6d6951-ebd9-41fb-b41f-86b68db6ae68", "name": "network-vif-deleted", "tag": "c2cb00cb-2858-4fe5-9e7a-7be0435be386"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:09:23.041302 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5f90282c-1516-4385-850a-0f108ac0685d req-7bb2f4f5-a0df-47ce-8ad9-0aa62af5a858 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:23.041786 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5f90282c-1516-4385-850a-0f108ac0685d req-7bb2f4f5-a0df-47ce-8ad9-0aa62af5a858 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:23.042220 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-5f90282c-1516-4385-850a-0f108ac0685d req-7bb2f4f5-a0df-47ce-8ad9-0aa62af5a858 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:23.052962 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-5f90282c-1516-4385-850a-0f108ac0685d req-7bb2f4f5-a0df-47ce-8ad9-0aa62af5a858 service nova] Creating event network-vif-deleted:c2cb00cb-2858-4fe5-9e7a-7be0435be386 for instance 0f6d6951-ebd9-41fb-b41f-86b68db6ae68 on hv-cinder-83602 Aug 10 17:09:23.057744 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-5f90282c-1516-4385-850a-0f108ac0685d req-7bb2f4f5-a0df-47ce-8ad9-0aa62af5a858 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032163 Aug 10 17:09:23.058330 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 711/1407] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:09:23.958538 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:23.959146 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 0f6d6951-ebd9-41fb-b41f-86b68db6ae68] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:23.966241 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:23.966717 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:23.967151 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:23.967835 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:23.968317 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:23.968737 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:23.984318 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] HTTP exception thrown: Instance 0f6d6951-ebd9-41fb-b41f-86b68db6ae68 could not be found. Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Request method failure captured: Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 HTTP/1.1 Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-POFMQbrLZhi0ekXnpzfX-UTdvXoDzd7OKt3j0CDY7vdmo7zP-sGD3vYPJRAkoKUyO2fIpZto63yRhEIkqJ00cHxekSKFlaN0G-MagbXH5aSy-Tbx70UIz1yia9x5nBg51JauVhBjmKQHYBmRByk_pz4VLHtTzdpBF6qsxG2UN4D9E Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: 41311d9aa3f54596a61033b0ea82ba80 Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:09:23.985934 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41311d9aa3f54596a61033b0ea82ba80", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: 41311d9aa3f54596a61033b0ea82ba80 Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-TestVolumeBootPattern-1712367006-project Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: a1c78f05a0f24151a1884faed65d286e Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-TestVolumeBootPattern-1712367006-project Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance 0f6d6951-ebd9-41fb-b41f-86b68db6ae68 could not be found. Aug 10 17:09:23.987753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': '0f6d6951-ebd9-41fb-b41f-86b68db6ae68'} Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f6d6951-ebd9-41fb-b41f-86b68db6ae68 could not be found. Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:09:23.988778 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f6d6951-ebd9-41fb-b41f-86b68db6ae68 could not be found. Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f6d6951-ebd9-41fb-b41f-86b68db6ae68 could not be found. Aug 10 17:09:23.990286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:09:23.991577 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Returning 404 to user: Instance 0f6d6951-ebd9-41fb-b41f-86b68db6ae68 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:09:23.991577 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d4b5f64a-26ef-44e4-b11f-c6fa5f402492 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68" status: 404 len: 111 microversion: 2.1 time: 0.032694 Aug 10 17:09:23.991577 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 697/1408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:09:23 2022] GET /compute/v2.1/servers/0f6d6951-ebd9-41fb-b41f-86b68db6ae68 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:09:27.029606 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bc4c8ead-1d0a-4bc8-9b8f-ca46ef6c3515 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:27.030188 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bc4c8ead-1d0a-4bc8-9b8f-ca46ef6c3515 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:27.034821 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f4b1c1b4-8673-438c-bd50-b6bf905cd97e req-179f04b7-fa05-4347-9cd4-45bd60cb49a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44756d90-0dd3-4231-a768-4460a6749013", "tag": "549da651-b25e-4fad-ae25-10f3ee253154"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:09:27.037083 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc4c8ead-1d0a-4bc8-9b8f-ca46ef6c3515 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:27.038132 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc4c8ead-1d0a-4bc8-9b8f-ca46ef6c3515 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:27.038604 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc4c8ead-1d0a-4bc8-9b8f-ca46ef6c3515 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:27.039305 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc4c8ead-1d0a-4bc8-9b8f-ca46ef6c3515 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:27.039765 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc4c8ead-1d0a-4bc8-9b8f-ca46ef6c3515 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:27.040369 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc4c8ead-1d0a-4bc8-9b8f-ca46ef6c3515 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:27.056048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f4b1c1b4-8673-438c-bd50-b6bf905cd97e req-179f04b7-fa05-4347-9cd4-45bd60cb49a7 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:27.056564 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f4b1c1b4-8673-438c-bd50-b6bf905cd97e req-179f04b7-fa05-4347-9cd4-45bd60cb49a7 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:27.056996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f4b1c1b4-8673-438c-bd50-b6bf905cd97e req-179f04b7-fa05-4347-9cd4-45bd60cb49a7 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:27.068564 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bc4c8ead-1d0a-4bc8-9b8f-ca46ef6c3515 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:09:27.070835 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f4b1c1b4-8673-438c-bd50-b6bf905cd97e req-179f04b7-fa05-4347-9cd4-45bd60cb49a7 service nova] Creating event network-changed:549da651-b25e-4fad-ae25-10f3ee253154 for instance 44756d90-0dd3-4231-a768-4460a6749013 on hv-cinder-83602 Aug 10 17:09:27.075956 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f4b1c1b4-8673-438c-bd50-b6bf905cd97e req-179f04b7-fa05-4347-9cd4-45bd60cb49a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044760 Aug 10 17:09:27.076775 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 698/1409] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:09:27.152393 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bc4c8ead-1d0a-4bc8-9b8f-ca46ef6c3515 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "DELETE /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 204 len: 0 microversion: 2.1 time: 0.126658 Aug 10 17:09:27.153063 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 712/1410] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:09:27 2022] DELETE /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:09:27.166022 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-97542408-8913-4b81-a246-609a629c27c8 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:27.168795 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-97542408-8913-4b81-a246-609a629c27c8 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:27.177132 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97542408-8913-4b81-a246-609a629c27c8 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:27.177632 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97542408-8913-4b81-a246-609a629c27c8 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:27.178274 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97542408-8913-4b81-a246-609a629c27c8 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:27.179298 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97542408-8913-4b81-a246-609a629c27c8 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:27.179927 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97542408-8913-4b81-a246-609a629c27c8 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:27.181160 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97542408-8913-4b81-a246-609a629c27c8 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:27.312897 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-97542408-8913-4b81-a246-609a629c27c8 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:09:27.320977 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-97542408-8913-4b81-a246-609a629c27c8 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1577 microversion: 2.1 time: 0.162983 Aug 10 17:09:27.321560 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 699/1411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:09:27 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:09:28.344909 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-62651842-fe62-43f3-89c5-7cc0b2c91800 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:28.345783 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-62651842-fe62-43f3-89c5-7cc0b2c91800 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:28.352178 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62651842-fe62-43f3-89c5-7cc0b2c91800 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:28.352750 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62651842-fe62-43f3-89c5-7cc0b2c91800 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:28.353252 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62651842-fe62-43f3-89c5-7cc0b2c91800 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:28.354060 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62651842-fe62-43f3-89c5-7cc0b2c91800 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:28.354578 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62651842-fe62-43f3-89c5-7cc0b2c91800 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:28.355004 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62651842-fe62-43f3-89c5-7cc0b2c91800 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:28.489373 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-62651842-fe62-43f3-89c5-7cc0b2c91800 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c78f05a0f24151a1884faed65d286e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41311d9aa3f54596a61033b0ea82ba80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:09:28.497685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-62651842-fe62-43f3-89c5-7cc0b2c91800 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 200 len: 1458 microversion: 2.1 time: 0.156955 Aug 10 17:09:28.498218 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 713/1412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:09:28 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 1458 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:09:28.582485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c012cbb5-45b6-4e9d-9641-2d6dbca7c230 req-9910f93e-ed2b-4c19-ad5b-0b8a5b61effc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44756d90-0dd3-4231-a768-4460a6749013", "name": "network-vif-deleted", "tag": "549da651-b25e-4fad-ae25-10f3ee253154"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:09:28.593537 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c012cbb5-45b6-4e9d-9641-2d6dbca7c230 req-9910f93e-ed2b-4c19-ad5b-0b8a5b61effc service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:28.594059 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c012cbb5-45b6-4e9d-9641-2d6dbca7c230 req-9910f93e-ed2b-4c19-ad5b-0b8a5b61effc service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:28.594492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c012cbb5-45b6-4e9d-9641-2d6dbca7c230 req-9910f93e-ed2b-4c19-ad5b-0b8a5b61effc service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:28.605275 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c012cbb5-45b6-4e9d-9641-2d6dbca7c230 req-9910f93e-ed2b-4c19-ad5b-0b8a5b61effc service nova] Creating event network-vif-deleted:549da651-b25e-4fad-ae25-10f3ee253154 for instance 44756d90-0dd3-4231-a768-4460a6749013 on hv-cinder-83602 Aug 10 17:09:28.609899 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c012cbb5-45b6-4e9d-9641-2d6dbca7c230 req-9910f93e-ed2b-4c19-ad5b-0b8a5b61effc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031143 Aug 10 17:09:28.610467 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 700/1413] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:09:29.519702 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:29.520366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: 44756d90-0dd3-4231-a768-4460a6749013] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:29.526687 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:29.527174 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:29.527607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:29.528329 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:29.528782 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:29.529207 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:29.542146 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] HTTP exception thrown: Instance 44756d90-0dd3-4231-a768-4460a6749013 could not be found. Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Request method failure captured: Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 HTTP/1.1 Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-POFMQbrLZhi0ekXnpzfX-UTdvXoDzd7OKt3j0CDY7vdmo7zP-sGD3vYPJRAkoKUyO2fIpZto63yRhEIkqJ00cHxekSKFlaN0G-MagbXH5aSy-Tbx70UIz1yia9x5nBg51JauVhBjmKQHYBmRByk_pz4VLHtTzdpBF6qsxG2UN4D9E Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 41311d9aa3f54596a61033b0ea82ba80 Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:09:29.543751 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41311d9aa3f54596a61033b0ea82ba80", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 41311d9aa3f54596a61033b0ea82ba80 Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-TestVolumeBootPattern-1712367006-project Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: a1c78f05a0f24151a1884faed65d286e Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-TestVolumeBootPattern-1712367006-project Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 44756d90-0dd3-4231-a768-4460a6749013 could not be found. Aug 10 17:09:29.545477 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '44756d90-0dd3-4231-a768-4460a6749013'} Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44756d90-0dd3-4231-a768-4460a6749013 could not be found. Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:09:29.546643 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44756d90-0dd3-4231-a768-4460a6749013 could not be found. Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44756d90-0dd3-4231-a768-4460a6749013 could not be found. Aug 10 17:09:29.548372 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:09:29.549914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Returning 404 to user: Instance 44756d90-0dd3-4231-a768-4460a6749013 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:09:29.549914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-35244c1c-0c63-4429-a8b0-9fcb61ef078c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013" status: 404 len: 111 microversion: 2.1 time: 0.029303 Aug 10 17:09:29.549914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 714/1414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:09:29 2022] GET /compute/v2.1/servers/44756d90-0dd3-4231-a768-4460a6749013 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:09:29.981404 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:29.981991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:29.988015 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:29.988536 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:29.988974 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:29.989663 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:29.990117 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:29.990545 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:30.004345 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] HTTP exception thrown: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Request method failure captured: Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e HTTP/1.1 Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept: application/json Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Accept-Encoding: identity Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Connection: close Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Length: 0 Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Content-Type: application/json Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Host: 10.222.0.25 Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Openstack-System-Scope: None Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.11 Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Auth-Token: gAAAAABi8-POFMQbrLZhi0ekXnpzfX-UTdvXoDzd7OKt3j0CDY7vdmo7zP-sGD3vYPJRAkoKUyO2fIpZto63yRhEIkqJ00cHxekSKFlaN0G-MagbXH5aSy-Tbx70UIz1yia9x5nBg51JauVhBjmKQHYBmRByk_pz4VLHtTzdpBF6qsxG2UN4D9E Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Id: None Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Domain-Name: None Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Identity-Status: Confirmed Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Is-Admin-Project: True Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Id: default Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Domain-Name: Default Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Id: 41311d9aa3f54596a61033b0ea82ba80 Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Project-Name: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Role: reader,member Aug 10 17:09:30.006048 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Roles: reader,member Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41311d9aa3f54596a61033b0ea82ba80", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Id: 41311d9aa3f54596a61033b0ea82ba80 Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User: tempest-TestVolumeBootPattern-1712367006-project Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Id: default Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Domain-Name: Default Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Id: a1c78f05a0f24151a1884faed65d286e Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: X-User-Name: tempest-TestVolumeBootPattern-1712367006-project Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: method: > Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: exception: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:09:30.007785 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: action_args: {'id': 'f6995ac7-abff-47f3-a48c-a24fc437717e'} Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:09:30.008922 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:09:30.010485 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Aug 10 17:09:30.012201 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Returning 404 to user: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:09:30.012201 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c32f47e3-b48b-4d4a-972b-6ac1575b194c tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 404 len: 111 microversion: 2.1 time: 0.030713 Aug 10 17:09:30.012201 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 701/1415] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:09:29 2022] DELETE /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:09:30.015761 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:30.016396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] [instance: f6995ac7-abff-47f3-a48c-a24fc437717e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:30.022708 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:30.023194 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:30.023624 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:30.024339 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:30.024800 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:30.025216 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:30.038710 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] HTTP exception thrown: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Request method failure captured: Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e HTTP/1.1 Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-POFMQbrLZhi0ekXnpzfX-UTdvXoDzd7OKt3j0CDY7vdmo7zP-sGD3vYPJRAkoKUyO2fIpZto63yRhEIkqJ00cHxekSKFlaN0G-MagbXH5aSy-Tbx70UIz1yia9x5nBg51JauVhBjmKQHYBmRByk_pz4VLHtTzdpBF6qsxG2UN4D9E Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: 41311d9aa3f54596a61033b0ea82ba80 Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:09:30.040228 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41311d9aa3f54596a61033b0ea82ba80", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41311d9aa3f54596a61033b0ea82ba80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 41311d9aa3f54596a61033b0ea82ba80 Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712367006 Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-TestVolumeBootPattern-1712367006-project Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: a1c78f05a0f24151a1884faed65d286e Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-TestVolumeBootPattern-1712367006-project Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:09:30.041890 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': 'f6995ac7-abff-47f3-a48c-a24fc437717e'} Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:09:30.043119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. Aug 10 17:09:30.044882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:09:30.046314 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Returning 404 to user: Instance f6995ac7-abff-47f3-a48c-a24fc437717e could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:09:30.046314 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d2b8ee7c-a722-4158-8b8e-1eb4510a2b68 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e" status: 404 len: 111 microversion: 2.1 time: 0.029583 Aug 10 17:09:30.046314 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 715/1416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:09:30 2022] GET /compute/v2.1/servers/f6995ac7-abff-47f3-a48c-a24fc437717e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:09:31.338143 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bd95cd4f-4437-4e52-bf13-abe53f05fb16 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] Calling method '.version_select at 0x7f5b0846eb80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:31.356965 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bd95cd4f-4437-4e52-bf13-abe53f05fb16 tempest-TestVolumeBootPattern-1712367006 tempest-TestVolumeBootPattern-1712367006-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-465937417" status: 202 len: 0 microversion: 2.1 time: 0.023547 Aug 10 17:09:31.357552 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 702/1417] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Aug 10 17:09:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-465937417 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:09:58.702238 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-87469d50-0c4a-48c0-a1eb-bfe7e4ccc821 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:09:58.704446 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-87469d50-0c4a-48c0-a1eb-bfe7e4ccc821 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:58.706762 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:58.707574 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:58.713913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-87469d50-0c4a-48c0-a1eb-bfe7e4ccc821 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:58.714401 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-87469d50-0c4a-48c0-a1eb-bfe7e4ccc821 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:58.714837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-87469d50-0c4a-48c0-a1eb-bfe7e4ccc821 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:58.715525 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-87469d50-0c4a-48c0-a1eb-bfe7e4ccc821 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:58.715976 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-87469d50-0c4a-48c0-a1eb-bfe7e4ccc821 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:58.716423 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-87469d50-0c4a-48c0-a1eb-bfe7e4ccc821 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:58.786664 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-87469d50-0c4a-48c0-a1eb-bfe7e4ccc821 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "POST /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/action" status: 202 len: 0 microversion: 2.1 time: 0.088041 Aug 10 17:09:58.788215 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 716/1418] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 17:09:58 2022] POST /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:09:58.793695 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=28 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:58.794538 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:58.799014 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b9e3201f-c834-4fc6-8835-34d974d9a46a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:09:58.799688 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b9e3201f-c834-4fc6-8835-34d974d9a46a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:09:58.807646 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e3201f-c834-4fc6-8835-34d974d9a46a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:58.808131 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e3201f-c834-4fc6-8835-34d974d9a46a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:58.808591 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e3201f-c834-4fc6-8835-34d974d9a46a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:58.809286 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e3201f-c834-4fc6-8835-34d974d9a46a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:09:58.809738 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e3201f-c834-4fc6-8835-34d974d9a46a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:09:58.810165 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e3201f-c834-4fc6-8835-34d974d9a46a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:09:59.237817 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-b9e3201f-c834-4fc6-8835-34d974d9a46a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:09:59.245827 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b9e3201f-c834-4fc6-8835-34d974d9a46a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1750 microversion: 2.1 time: 0.453630 Aug 10 17:09:59.246392 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 703/1419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:09:58 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1750 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:10:00.267817 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-80e16dcd-c6bf-4f11-82c6-3c7e8abb7327 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:10:00.268540 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-80e16dcd-c6bf-4f11-82c6-3c7e8abb7327 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:10:00.274607 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80e16dcd-c6bf-4f11-82c6-3c7e8abb7327 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:00.275087 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80e16dcd-c6bf-4f11-82c6-3c7e8abb7327 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:00.275536 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80e16dcd-c6bf-4f11-82c6-3c7e8abb7327 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:00.276256 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80e16dcd-c6bf-4f11-82c6-3c7e8abb7327 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:00.276712 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80e16dcd-c6bf-4f11-82c6-3c7e8abb7327 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:00.277140 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-80e16dcd-c6bf-4f11-82c6-3c7e8abb7327 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:00.486942 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-80e16dcd-c6bf-4f11-82c6-3c7e8abb7327 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:10:00.495329 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-80e16dcd-c6bf-4f11-82c6-3c7e8abb7327 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1755 microversion: 2.1 time: 0.232284 Aug 10 17:10:00.495875 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 717/1420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:10:00 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1755 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:10:01.516298 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d9c92846-b5da-4c71-86d6-c048dfdb5a44 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:10:01.516906 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d9c92846-b5da-4c71-86d6-c048dfdb5a44 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:10:01.523251 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c92846-b5da-4c71-86d6-c048dfdb5a44 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:01.523723 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c92846-b5da-4c71-86d6-c048dfdb5a44 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:01.524166 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c92846-b5da-4c71-86d6-c048dfdb5a44 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:01.524858 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c92846-b5da-4c71-86d6-c048dfdb5a44 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:01.525305 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c92846-b5da-4c71-86d6-c048dfdb5a44 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:01.525722 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c92846-b5da-4c71-86d6-c048dfdb5a44 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:01.667352 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9c92846-b5da-4c71-86d6-c048dfdb5a44 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:10:01.675222 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d9c92846-b5da-4c71-86d6-c048dfdb5a44 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1755 microversion: 2.1 time: 0.162763 Aug 10 17:10:01.675782 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 704/1421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:10:01 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:10:02.161882 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:10:02.162333 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Wed Aug 10 17:10:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:10:02.696311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-15673cd6-f6cf-46da-9c94-3acb511197b0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:10:02.696914 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-15673cd6-f6cf-46da-9c94-3acb511197b0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:10:02.703366 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15673cd6-f6cf-46da-9c94-3acb511197b0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:02.703849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15673cd6-f6cf-46da-9c94-3acb511197b0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:02.704392 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15673cd6-f6cf-46da-9c94-3acb511197b0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:02.705094 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15673cd6-f6cf-46da-9c94-3acb511197b0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:02.705531 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15673cd6-f6cf-46da-9c94-3acb511197b0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:02.705958 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15673cd6-f6cf-46da-9c94-3acb511197b0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:02.850199 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-15673cd6-f6cf-46da-9c94-3acb511197b0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:10:02.857954 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-15673cd6-f6cf-46da-9c94-3acb511197b0 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1755 microversion: 2.1 time: 0.165580 Aug 10 17:10:02.858510 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 718/1422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:10:02 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:10:03.880009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f5b7275-134d-4829-b588-aa940048e5fa tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:10:03.880653 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0f5b7275-134d-4829-b588-aa940048e5fa tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:10:03.887030 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f5b7275-134d-4829-b588-aa940048e5fa tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:03.887511 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f5b7275-134d-4829-b588-aa940048e5fa tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:03.887939 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f5b7275-134d-4829-b588-aa940048e5fa tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:03.888644 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f5b7275-134d-4829-b588-aa940048e5fa tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:03.889096 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f5b7275-134d-4829-b588-aa940048e5fa tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:03.889517 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f5b7275-134d-4829-b588-aa940048e5fa tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:04.031806 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-0f5b7275-134d-4829-b588-aa940048e5fa tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:10:04.040407 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f5b7275-134d-4829-b588-aa940048e5fa tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1755 microversion: 2.1 time: 0.164165 Aug 10 17:10:04.040979 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 705/1423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:10:03 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:10:05.061125 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-969ef295-4df8-4f0c-8224-2fc5b7526a12 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:10:05.061722 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-969ef295-4df8-4f0c-8224-2fc5b7526a12 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:10:05.067992 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef295-4df8-4f0c-8224-2fc5b7526a12 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:05.068980 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef295-4df8-4f0c-8224-2fc5b7526a12 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:05.069413 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef295-4df8-4f0c-8224-2fc5b7526a12 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:05.070085 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef295-4df8-4f0c-8224-2fc5b7526a12 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:05.070528 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef295-4df8-4f0c-8224-2fc5b7526a12 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:05.070941 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-969ef295-4df8-4f0c-8224-2fc5b7526a12 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:05.214573 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-969ef295-4df8-4f0c-8224-2fc5b7526a12 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:10:05.222396 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-969ef295-4df8-4f0c-8224-2fc5b7526a12 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1755 microversion: 2.1 time: 0.165165 Aug 10 17:10:05.222956 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 719/1424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:10:05 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:10:06.244398 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-43ace93d-095c-4f35-83a7-4a7553a3fb32 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:10:06.244989 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-43ace93d-095c-4f35-83a7-4a7553a3fb32 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:10:06.251274 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43ace93d-095c-4f35-83a7-4a7553a3fb32 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:06.251750 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43ace93d-095c-4f35-83a7-4a7553a3fb32 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:06.252207 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43ace93d-095c-4f35-83a7-4a7553a3fb32 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:06.252894 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43ace93d-095c-4f35-83a7-4a7553a3fb32 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:06.253343 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43ace93d-095c-4f35-83a7-4a7553a3fb32 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:06.253762 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43ace93d-095c-4f35-83a7-4a7553a3fb32 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:06.400762 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-43ace93d-095c-4f35-83a7-4a7553a3fb32 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:10:06.408583 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-43ace93d-095c-4f35-83a7-4a7553a3fb32 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1755 microversion: 2.1 time: 0.168720 Aug 10 17:10:06.409153 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 706/1425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:10:06 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:10:07.430921 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9f982c2e-e3ff-4344-935d-51a39a19fec8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:10:07.431524 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9f982c2e-e3ff-4344-935d-51a39a19fec8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:10:07.437771 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f982c2e-e3ff-4344-935d-51a39a19fec8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:07.438249 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f982c2e-e3ff-4344-935d-51a39a19fec8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:07.438674 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f982c2e-e3ff-4344-935d-51a39a19fec8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:07.439360 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f982c2e-e3ff-4344-935d-51a39a19fec8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:07.439799 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f982c2e-e3ff-4344-935d-51a39a19fec8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:07.440309 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f982c2e-e3ff-4344-935d-51a39a19fec8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:07.578990 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9f982c2e-e3ff-4344-935d-51a39a19fec8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:10:07.587344 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9f982c2e-e3ff-4344-935d-51a39a19fec8 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1755 microversion: 2.1 time: 0.160820 Aug 10 17:10:07.587904 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 720/1426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:10:07 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:10:08.609000 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7d9111fb-366c-40cd-a63e-28a11856cf1d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:10:08.609603 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7d9111fb-366c-40cd-a63e-28a11856cf1d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:10:08.616449 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d9111fb-366c-40cd-a63e-28a11856cf1d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:08.616929 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d9111fb-366c-40cd-a63e-28a11856cf1d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:08.617361 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d9111fb-366c-40cd-a63e-28a11856cf1d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:08.618044 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d9111fb-366c-40cd-a63e-28a11856cf1d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:08.618494 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d9111fb-366c-40cd-a63e-28a11856cf1d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:08.618915 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d9111fb-366c-40cd-a63e-28a11856cf1d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:08.760235 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-7d9111fb-366c-40cd-a63e-28a11856cf1d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:10:08.768031 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7d9111fb-366c-40cd-a63e-28a11856cf1d tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1755 microversion: 2.1 time: 0.162936 Aug 10 17:10:08.768618 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 707/1427] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:10:08 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:10:09.789947 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-52f905c6-d852-417a-ae8a-28708f340a30 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:10:09.790653 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-52f905c6-d852-417a-ae8a-28708f340a30 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:10:09.797056 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f905c6-d852-417a-ae8a-28708f340a30 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:09.797533 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f905c6-d852-417a-ae8a-28708f340a30 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:09.797963 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f905c6-d852-417a-ae8a-28708f340a30 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:09.798648 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f905c6-d852-417a-ae8a-28708f340a30 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:09.799119 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f905c6-d852-417a-ae8a-28708f340a30 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:09.799537 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f905c6-d852-417a-ae8a-28708f340a30 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:09.940009 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-52f905c6-d852-417a-ae8a-28708f340a30 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:10:09.948698 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-52f905c6-d852-417a-ae8a-28708f340a30 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1755 microversion: 2.1 time: 0.162657 Aug 10 17:10:09.949248 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 721/1428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:10:09 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:10:10.969627 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4ace59a-2045-4d72-b040-cac2d3657bfd tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:10:10.970225 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4ace59a-2045-4d72-b040-cac2d3657bfd tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:10:10.977354 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4ace59a-2045-4d72-b040-cac2d3657bfd tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:10.977830 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4ace59a-2045-4d72-b040-cac2d3657bfd tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:10.978276 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4ace59a-2045-4d72-b040-cac2d3657bfd tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:10.978991 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4ace59a-2045-4d72-b040-cac2d3657bfd tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:10:10.979498 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4ace59a-2045-4d72-b040-cac2d3657bfd tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:10:10.979943 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4ace59a-2045-4d72-b040-cac2d3657bfd tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:10:11.120438 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4ace59a-2045-4d72-b040-cac2d3657bfd tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:10:11.129281 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4ace59a-2045-4d72-b040-cac2d3657bfd tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1758 microversion: 2.1 time: 0.163541 Aug 10 17:10:11.129856 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 708/1429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:10:10 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:11:14.419687 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=12 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:14.420462 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:14.424644 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-55b78006-4f31-44db-92e8-d5213cd7a3a3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1986694144"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:11:14.425176 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-55b78006-4f31-44db-92e8-d5213cd7a3a3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:11:14.432972 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b78006-4f31-44db-92e8-d5213cd7a3a3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:14.433486 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b78006-4f31-44db-92e8-d5213cd7a3a3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:14.433924 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b78006-4f31-44db-92e8-d5213cd7a3a3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:14.434614 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b78006-4f31-44db-92e8-d5213cd7a3a3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:14.435059 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b78006-4f31-44db-92e8-d5213cd7a3a3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:14.435479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-55b78006-4f31-44db-92e8-d5213cd7a3a3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:14.565479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.network.security_group_api [None req-55b78006-4f31-44db-92e8-d5213cd7a3a3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Removing security group 1fc03878-78d7-46b0-aba3-e0acff44f84f from port d6c042fa-473d-49e5-83ca-b4b9312cfedd Aug 10 17:11:14.858990 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-55b78006-4f31-44db-92e8-d5213cd7a3a3 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "POST /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/action" status: 202 len: 0 microversion: 2.1 time: 0.440841 Aug 10 17:11:14.859592 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 722/1430] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Aug 10 17:11:14 2022] POST /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:11:14.869551 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ee0e8ad9-cadf-4e7d-a7d3-9a43ddad1f37 req-0d52f36d-9680-40e3-8686-ea5a29f2ac6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa276f8-e157-44af-a52d-6e7a4565683e", "tag": "d6c042fa-473d-49e5-83ca-b4b9312cfedd"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:11:14.874719 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=12 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:14.875379 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=36 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:14.883411 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ee0e8ad9-cadf-4e7d-a7d3-9a43ddad1f37 req-0d52f36d-9680-40e3-8686-ea5a29f2ac6b service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:14.884065 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ee0e8ad9-cadf-4e7d-a7d3-9a43ddad1f37 req-0d52f36d-9680-40e3-8686-ea5a29f2ac6b service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:14.885616 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ee0e8ad9-cadf-4e7d-a7d3-9a43ddad1f37 req-0d52f36d-9680-40e3-8686-ea5a29f2ac6b service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:14.898099 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ee0e8ad9-cadf-4e7d-a7d3-9a43ddad1f37 req-0d52f36d-9680-40e3-8686-ea5a29f2ac6b service nova] Creating event network-changed:d6c042fa-473d-49e5-83ca-b4b9312cfedd for instance 7fa276f8-e157-44af-a52d-6e7a4565683e on hv-cinder-83602 Aug 10 17:11:14.903890 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ee0e8ad9-cadf-4e7d-a7d3-9a43ddad1f37 req-0d52f36d-9680-40e3-8686-ea5a29f2ac6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040380 Aug 10 17:11:14.904605 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 709/1431] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:11:15.949554 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8bda73c1-1fbf-47a0-a21d-28f2b43a8852 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:11:15.950084 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8bda73c1-1fbf-47a0-a21d-28f2b43a8852 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:11:15.956017 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8bda73c1-1fbf-47a0-a21d-28f2b43a8852 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:15.956670 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8bda73c1-1fbf-47a0-a21d-28f2b43a8852 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:15.957099 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8bda73c1-1fbf-47a0-a21d-28f2b43a8852 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:15.957780 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8bda73c1-1fbf-47a0-a21d-28f2b43a8852 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:15.958222 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8bda73c1-1fbf-47a0-a21d-28f2b43a8852 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:15.958639 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8bda73c1-1fbf-47a0-a21d-28f2b43a8852 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:16.044081 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-8bda73c1-1fbf-47a0-a21d-28f2b43a8852 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lazy-loading 'services' on Instance uuid 7fa276f8-e157-44af-a52d-6e7a4565683e {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:11:16.124274 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8bda73c1-1fbf-47a0-a21d-28f2b43a8852 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/os-volume_attachments/d5e99193-3e7e-4894-b6a2-3d790d5bca17" status: 202 len: 0 microversion: 2.1 time: 0.180133 Aug 10 17:11:16.124866 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 723/1432] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 17:11:15 2022] DELETE /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/os-volume_attachments/d5e99193-3e7e-4894-b6a2-3d790d5bca17 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:11:16.140996 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0253df5c-58c3-45e1-a749-eb07dcfaa546 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:11:16.145773 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0253df5c-58c3-45e1-a749-eb07dcfaa546 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:11:16.157793 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0253df5c-58c3-45e1-a749-eb07dcfaa546 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:16.158760 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0253df5c-58c3-45e1-a749-eb07dcfaa546 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:16.159506 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0253df5c-58c3-45e1-a749-eb07dcfaa546 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:16.160371 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0253df5c-58c3-45e1-a749-eb07dcfaa546 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:16.160919 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0253df5c-58c3-45e1-a749-eb07dcfaa546 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:16.161411 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0253df5c-58c3-45e1-a749-eb07dcfaa546 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:16.192399 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0253df5c-58c3-45e1-a749-eb07dcfaa546 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060129 Aug 10 17:11:16.193321 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 710/1433] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:11:16 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:11:16.919722 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-9788d33b-1ed2-4572-85ae-7c0ecaeec944 req-6b5f2d1d-4c66-4447-828c-93bf47073539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa276f8-e157-44af-a52d-6e7a4565683e", "tag": "d6c042fa-473d-49e5-83ca-b4b9312cfedd"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:11:16.929189 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-9788d33b-1ed2-4572-85ae-7c0ecaeec944 req-6b5f2d1d-4c66-4447-828c-93bf47073539 service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:16.929687 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-9788d33b-1ed2-4572-85ae-7c0ecaeec944 req-6b5f2d1d-4c66-4447-828c-93bf47073539 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:16.930117 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-9788d33b-1ed2-4572-85ae-7c0ecaeec944 req-6b5f2d1d-4c66-4447-828c-93bf47073539 service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:16.940852 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-9788d33b-1ed2-4572-85ae-7c0ecaeec944 req-6b5f2d1d-4c66-4447-828c-93bf47073539 service nova] Creating event network-changed:d6c042fa-473d-49e5-83ca-b4b9312cfedd for instance 7fa276f8-e157-44af-a52d-6e7a4565683e on hv-cinder-83602 Aug 10 17:11:16.945493 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-9788d33b-1ed2-4572-85ae-7c0ecaeec944 req-6b5f2d1d-4c66-4447-828c-93bf47073539 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029836 Aug 10 17:11:16.946061 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 724/1434] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:11:17.205013 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f40a50a9-1aed-4d2a-953d-1761153f6653 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:11:17.207156 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f40a50a9-1aed-4d2a-953d-1761153f6653 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:11:17.214523 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f40a50a9-1aed-4d2a-953d-1761153f6653 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:17.215011 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f40a50a9-1aed-4d2a-953d-1761153f6653 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:17.215451 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f40a50a9-1aed-4d2a-953d-1761153f6653 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:17.216351 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f40a50a9-1aed-4d2a-953d-1761153f6653 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:17.216855 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f40a50a9-1aed-4d2a-953d-1761153f6653 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:17.217306 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f40a50a9-1aed-4d2a-953d-1761153f6653 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:17.245803 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f40a50a9-1aed-4d2a-953d-1761153f6653 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044743 Aug 10 17:11:17.246381 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 711/1435] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Aug 10 17:11:17 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:11:17.257961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:11:17.258509 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:11:17.265444 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:17.265926 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:17.266363 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:17.267060 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:17.267517 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:17.267943 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:17.346167 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] HTTP exception thrown: Instance 7fa276f8-e157-44af-a52d-6e7a4565683e is not attached to volume d5e99193-3e7e-4894-b6a2-3d790d5bca17 Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Request method failure captured: Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: DELETE /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/os-volume_attachments/d5e99193-3e7e-4894-b6a2-3d790d5bca17 HTTP/1.1 Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Xcg_-WWpyzjBOpGi9-hTxxbTrDvtqGbmqsTwtQt422klkeTsIfN3PfDW0BTwaOFeCEBjs7BxtFxd-zW_LLwWGNWJuXM7LZDGtAxSVIH1pcw8MUde-wIZHi_rGQj32maaW6Vrwbb8IW7YACA_T7wi8D5hh9P4r5j3_h_sZxErzmySg Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: d7d69fb708ed447e8a190efb4be9d5f1 Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-TestMinimumBasicScenario-632231682 Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:11:17.348506 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:11:17.350311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7d69fb708ed447e8a190efb4be9d5f1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7d69fb708ed447e8a190efb4be9d5f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7d69fb708ed447e8a190efb4be9d5f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7d69fb708ed447e8a190efb4be9d5f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:11:17.350311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-TestMinimumBasicScenario-632231682 Aug 10 17:11:17.350311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: d7d69fb708ed447e8a190efb4be9d5f1 Aug 10 17:11:17.350311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-TestMinimumBasicScenario-632231682 Aug 10 17:11:17.350311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-TestMinimumBasicScenario-632231682-project Aug 10 17:11:17.350311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:11:17.350311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:11:17.350311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 226a40e02432469183e0f8b3360126dc Aug 10 17:11:17.350311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-TestMinimumBasicScenario-632231682-project Aug 10 17:11:17.350311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:11:17.350311 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 7fa276f8-e157-44af-a52d-6e7a4565683e is not attached to volume d5e99193-3e7e-4894-b6a2-3d790d5bca17 Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'server_id': '7fa276f8-e157-44af-a52d-6e7a4565683e', 'id': 'd5e99193-3e7e-4894-b6a2-3d790d5bca17'} Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d5e99193-3e7e-4894-b6a2-3d790d5bca17. Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:11:17.351447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa276f8-e157-44af-a52d-6e7a4565683e is not attached to volume d5e99193-3e7e-4894-b6a2-3d790d5bca17 Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa276f8-e157-44af-a52d-6e7a4565683e is not attached to volume d5e99193-3e7e-4894-b6a2-3d790d5bca17 Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:11:17.353101 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Returning 404 to user: Instance 7fa276f8-e157-44af-a52d-6e7a4565683e is not attached to volume d5e99193-3e7e-4894-b6a2-3d790d5bca17 {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:11:17.354548 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-16a6c3cb-6468-47fb-80cd-8e06fbe4e024 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/os-volume_attachments/d5e99193-3e7e-4894-b6a2-3d790d5bca17" status: 404 len: 154 microversion: 2.1 time: 0.096762 Aug 10 17:11:17.354548 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 725/1436] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Aug 10 17:11:17 2022] DELETE /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e/os-volume_attachments/d5e99193-3e7e-4894-b6a2-3d790d5bca17 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:11:18.497837 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-366945f1-fcca-4360-a079-5c2e72b6d2f4 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:11:18.498339 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-366945f1-fcca-4360-a079-5c2e72b6d2f4 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:11:18.504699 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-366945f1-fcca-4360-a079-5c2e72b6d2f4 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:18.505530 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-366945f1-fcca-4360-a079-5c2e72b6d2f4 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:18.505971 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-366945f1-fcca-4360-a079-5c2e72b6d2f4 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:18.506716 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-366945f1-fcca-4360-a079-5c2e72b6d2f4 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:18.507150 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-366945f1-fcca-4360-a079-5c2e72b6d2f4 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:18.507574 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-366945f1-fcca-4360-a079-5c2e72b6d2f4 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:18.533250 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-366945f1-fcca-4360-a079-5c2e72b6d2f4 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:11:18.606587 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-366945f1-fcca-4360-a079-5c2e72b6d2f4 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 204 len: 0 microversion: 2.1 time: 0.112301 Aug 10 17:11:18.607219 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 712/1437] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Aug 10 17:11:18 2022] DELETE /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:11:18.615447 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-29f86dbd-c4f9-4fdb-893a-f4845a5498cb tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:11:18.616049 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-29f86dbd-c4f9-4fdb-893a-f4845a5498cb tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:11:18.623211 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29f86dbd-c4f9-4fdb-893a-f4845a5498cb tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:18.623685 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29f86dbd-c4f9-4fdb-893a-f4845a5498cb tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:18.624110 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29f86dbd-c4f9-4fdb-893a-f4845a5498cb tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:18.624839 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29f86dbd-c4f9-4fdb-893a-f4845a5498cb tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:18.625284 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29f86dbd-c4f9-4fdb-893a-f4845a5498cb tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:18.625707 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29f86dbd-c4f9-4fdb-893a-f4845a5498cb tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:18.752518 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-29f86dbd-c4f9-4fdb-893a-f4845a5498cb tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:11:18.759837 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-29f86dbd-c4f9-4fdb-893a-f4845a5498cb tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1553 microversion: 2.1 time: 0.148296 Aug 10 17:11:18.760427 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 726/1438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:11:18 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:11:19.781904 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c8f6288a-2d5f-431c-8ba3-31c68525d9c6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:11:19.782753 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c8f6288a-2d5f-431c-8ba3-31c68525d9c6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:11:19.789009 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6288a-2d5f-431c-8ba3-31c68525d9c6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:19.789492 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6288a-2d5f-431c-8ba3-31c68525d9c6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:19.789923 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6288a-2d5f-431c-8ba3-31c68525d9c6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:19.790644 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6288a-2d5f-431c-8ba3-31c68525d9c6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:19.791098 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6288a-2d5f-431c-8ba3-31c68525d9c6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:19.791522 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6288a-2d5f-431c-8ba3-31c68525d9c6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:19.921656 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.policy [None req-c8f6288a-2d5f-431c-8ba3-31c68525d9c6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:11:19.929072 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c8f6288a-2d5f-431c-8ba3-31c68525d9c6 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1553 microversion: 2.1 time: 0.151390 Aug 10 17:11:19.929637 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 713/1439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:11:19 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:11:20.951461 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-22c7aba4-494f-45ec-8f5d-1d610dab4f7a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:11:20.952117 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-22c7aba4-494f-45ec-8f5d-1d610dab4f7a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:11:20.958424 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22c7aba4-494f-45ec-8f5d-1d610dab4f7a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:20.958913 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22c7aba4-494f-45ec-8f5d-1d610dab4f7a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:20.959348 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22c7aba4-494f-45ec-8f5d-1d610dab4f7a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:20.960049 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22c7aba4-494f-45ec-8f5d-1d610dab4f7a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:20.960760 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22c7aba4-494f-45ec-8f5d-1d610dab4f7a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:20.961189 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-22c7aba4-494f-45ec-8f5d-1d610dab4f7a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:21.034866 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-22c7aba4-494f-45ec-8f5d-1d610dab4f7a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a40e02432469183e0f8b3360126dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d69fb708ed447e8a190efb4be9d5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:11:21.042621 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-22c7aba4-494f-45ec-8f5d-1d610dab4f7a tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 200 len: 1511 microversion: 2.1 time: 0.096089 Aug 10 17:11:21.043212 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 727/1440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:11:20 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 1511 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:11:21.059839 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f946855d-9a09-43ed-82b1-203948835acb req-6a3fec04-7b4d-4c8c-8160-d6723077ac1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa276f8-e157-44af-a52d-6e7a4565683e", "name": "network-vif-deleted", "tag": "d6c042fa-473d-49e5-83ca-b4b9312cfedd"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:11:21.069659 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f946855d-9a09-43ed-82b1-203948835acb req-6a3fec04-7b4d-4c8c-8160-d6723077ac1b service nova] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:21.070152 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f946855d-9a09-43ed-82b1-203948835acb req-6a3fec04-7b4d-4c8c-8160-d6723077ac1b service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:21.070771 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f946855d-9a09-43ed-82b1-203948835acb req-6a3fec04-7b4d-4c8c-8160-d6723077ac1b service nova] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:21.083800 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f946855d-9a09-43ed-82b1-203948835acb req-6a3fec04-7b4d-4c8c-8160-d6723077ac1b service nova] Creating event network-vif-deleted:d6c042fa-473d-49e5-83ca-b4b9312cfedd for instance 7fa276f8-e157-44af-a52d-6e7a4565683e on hv-cinder-83602 Aug 10 17:11:21.089521 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f946855d-9a09-43ed-82b1-203948835acb req-6a3fec04-7b4d-4c8c-8160-d6723077ac1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033798 Aug 10 17:11:21.090546 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 714/1441] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Aug 10 17:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:11:22.063856 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:11:22.064497 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] [instance: 7fa276f8-e157-44af-a52d-6e7a4565683e] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:11:22.073191 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:22.073849 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:22.074782 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:22.075479 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Acquiring lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:11:22.075935 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:11:22.076389 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Lock "7aab5fae-6c58-46b3-86c8-a7c4cff86d61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:11:22.096192 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] HTTP exception thrown: Instance 7fa276f8-e157-44af-a52d-6e7a4565683e could not be found. Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Request method failure captured: Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e HTTP/1.1 Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Connection: close Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Host: 10.222.0.25 Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.11 Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABi8-Xcg_-WWpyzjBOpGi9-hTxxbTrDvtqGbmqsTwtQt422klkeTsIfN3PfDW0BTwaOFeCEBjs7BxtFxd-zW_LLwWGNWJuXM7LZDGtAxSVIH1pcw8MUde-wIZHi_rGQj32maaW6Vrwbb8IW7YACA_T7wi8D5hh9P4r5j3_h_sZxErzmySg Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Id: d7d69fb708ed447e8a190efb4be9d5f1 Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-TestMinimumBasicScenario-632231682 Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 10 17:11:22.097788 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7d69fb708ed447e8a190efb4be9d5f1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7d69fb708ed447e8a190efb4be9d5f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7d69fb708ed447e8a190efb4be9d5f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7d69fb708ed447e8a190efb4be9d5f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-TestMinimumBasicScenario-632231682 Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Id: d7d69fb708ed447e8a190efb4be9d5f1 Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-TestMinimumBasicScenario-632231682 Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User: tempest-TestMinimumBasicScenario-632231682-project Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Id: 226a40e02432469183e0f8b3360126dc Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-TestMinimumBasicScenario-632231682-project Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: method: > Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: exception: Instance 7fa276f8-e157-44af-a52d-6e7a4565683e could not be found. Aug 10 17:11:22.099597 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: action_args: {'id': '7fa276f8-e157-44af-a52d-6e7a4565683e'} Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa276f8-e157-44af-a52d-6e7a4565683e could not be found. Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:11:22.100576 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa276f8-e157-44af-a52d-6e7a4565683e could not be found. Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa276f8-e157-44af-a52d-6e7a4565683e could not be found. Aug 10 17:11:22.102267 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 10 17:11:22.103876 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Returning 404 to user: Instance 7fa276f8-e157-44af-a52d-6e7a4565683e could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:11:22.103876 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b5635021-ce99-4d9d-9609-7855b4afb085 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e" status: 404 len: 111 microversion: 2.1 time: 0.040510 Aug 10 17:11:22.103876 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 728/1442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Aug 10 17:11:22 2022] GET /compute/v2.1/servers/7fa276f8-e157-44af-a52d-6e7a4565683e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:11:22.109439 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fe4d3b64-8a18-4d51-95c8-5a015617e691 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] Calling method '.version_select at 0x7f5b0846e3a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:11:22.129125 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fe4d3b64-8a18-4d51-95c8-5a015617e691 tempest-TestMinimumBasicScenario-632231682 tempest-TestMinimumBasicScenario-632231682-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-318038365" status: 202 len: 0 microversion: 2.1 time: 0.024172 Aug 10 17:11:22.129721 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 715/1443] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Aug 10 17:11:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-318038365 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:11:44.426377 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:11:44.426897 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Wed Aug 10 17:11:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:13:19.406341 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:13:19.406952 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Wed Aug 10 17:13:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:13:22.169961 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:13:22.170549 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Wed Aug 10 17:13:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:13:37.832620 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:13:37.833270 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Wed Aug 10 17:13:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:15:04.434898 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:15:04.435356 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Wed Aug 10 17:15:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:16:37.064208 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:16:37.064926 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Wed Aug 10 17:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:16:39.417444 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:16:39.417874 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Wed Aug 10 17:16:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:16:42.177583 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:16:42.178105 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Wed Aug 10 17:16:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:16:56.956456 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:16:56.957086 dv-cinder-836027-6-iscsi devstack@n-api.service[120614]: Wed Aug 10 17:16:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:16:57.841499 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:16:57.842158 dv-cinder-836027-6-iscsi devstack@n-api.service[120608]: Wed Aug 10 17:16:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!